Jul 08 06:52:52.516253 ip-10-0-136-129 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 06:52:52.516265 ip-10-0-136-129 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 06:52:52.516274 ip-10-0-136-129 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 06:52:52.516511 ip-10-0-136-129 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 06:53:01.900335 ip-10-0-136-129 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 08 06:53:01.900348 ip-10-0-136-129 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a2bcf2a339714addb4961ba27c4cec8b --
Jul 08 06:54:38.987015 ip-10-0-136-129 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 06:54:39.426510 ip-10-0-136-129 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:54:39.426510 ip-10-0-136-129 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 06:54:39.426510 ip-10-0-136-129 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:54:39.426510 ip-10-0-136-129 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 06:54:39.426510 ip-10-0-136-129 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:54:39.427699 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.427624    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 06:54:39.431724 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431707    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:54:39.431784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431726    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:54:39.431784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431730    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:54:39.431784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431747    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:54:39.431784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431773    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431787    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431791    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431794    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431797    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431800    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431803    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431806    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431809    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431812    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431814    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431817    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431820    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431823    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431826    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431828    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431831    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431833    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431853    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431856    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:54:39.431881 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431859    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431862    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431867    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431872    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431875    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431878    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431881    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431884    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431887    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431890    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431892    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431895    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431898    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431902    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431905    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431908    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431911    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431914    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431917    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431919    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:54:39.432361 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431922    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431924    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431927    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431931    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431936    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431939    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431941    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431943    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431946    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431950    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431954    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431957    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431959    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431963    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431967    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431970    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431973    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431976    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431979    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431981    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:54:39.432888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431984    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431986    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431989    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431992    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431994    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.431997    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432000    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432002    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432004    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432007    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432009    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432012    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432015    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432022    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432024    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432027    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432030    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432033    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432035    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432038    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:54:39.433382 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432040    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432043    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432045    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432048    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432050    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432053    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432056    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432059    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432062    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432065    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432067    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432070    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432072    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432075    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:54:39.433888 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.432078    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:54:39.435626 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435610    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:54:39.435626 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435625    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435629    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435632    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435635    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435638    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435640    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435643    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435646    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435649    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435651    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435654    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435657    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435659    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435662    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435665    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435668    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435671    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435673    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435676    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435678    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:54:39.435689 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435681    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435684    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435686    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435689    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435692    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435695    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435698    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435700    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435703    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435706    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435708    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435710    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435713    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435715    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435718    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435721    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435723    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435726    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435728    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435731    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:54:39.436238 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435747    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435750    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435752    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435755    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435758    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435760    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435764    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435766    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435769    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435771    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435774    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435779    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435783    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435786    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435789    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435793    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435795    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435800    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435804    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:54:39.436746 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435807    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435810    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435813    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435815    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435818    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435821    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435823    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435826    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435828    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435831    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435833    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435836    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435838    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435842    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435845    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435847    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435850    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435853    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435855    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:54:39.437224 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435859    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435862    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435864    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435867    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435870    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435872    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435875    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435879    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435882    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435885    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435887    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435890    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435893    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435896    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435898    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435901    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435903    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435906    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435909    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.435913    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:54:39.437690 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436311    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436317    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436320    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436322    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436327    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436330    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436334    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436337    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436340    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436343    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436346    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436349    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436352    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436355    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436359    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436362    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436365    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436368    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436371    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:54:39.438195 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436373    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436376    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436378    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436381    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436384    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436386    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436389    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436392    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436394    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436397    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436399    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436402    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436405    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436407    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436410    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436412    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436415    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436417    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436420    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436423    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:54:39.438662 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436426    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436429    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436432    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436435    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436438    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436441    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436444    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436447    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436450    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436452    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436455    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436458    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436460    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436463    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436466    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436469    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436471    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436474    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436476    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436479    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:54:39.439170 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436482    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436485    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436487    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436490    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436492    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436495    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436497    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436500    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436502    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436504    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436507    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436509    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436512    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436514    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436517    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436519    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436522    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436524    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436527    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436529    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:54:39.439659 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436533    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436536    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436538    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436541    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436543    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436546    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436549    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436551    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436554    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436556    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436558    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436561    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436564    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436566    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436568    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436571    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436573    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436576    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436579    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:54:39.440167 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.436581    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436662    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436674    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436685    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436691    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436697    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436702    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436707    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436714    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436718    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436721    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436724    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436728    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436731    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436746    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436749    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436752    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436755    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436759    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436763    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436766    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436769    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436772    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436775    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 06:54:39.440627 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436779    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436782    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436785    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436791    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436794    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436797    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436800    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436803    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436806    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436810    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436813    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436816    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436819    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436821    2573 flags.go:64] FLAG: --enable-server="true"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436824    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436829    2573 flags.go:64] FLAG: --event-burst="100"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436831    2573 flags.go:64] FLAG: --event-qps="50"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436834    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436837    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436840    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436844    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436846    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436849    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436853    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436856    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 06:54:39.441325 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436858    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436862    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436865    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436868    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436871    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436874    2573 flags.go:64] FLAG: --feature-gates=""
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436878    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436881    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436884    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436887    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436892    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436895    2573 flags.go:64] FLAG: --help="false"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436898    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436901    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436903    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436906    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436910    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436913    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436916    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436918    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436921    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436924    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436927    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436930    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 06:54:39.441999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436932    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436935    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436938    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436941    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436944    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436946    2573 flags.go:64] FLAG: --lock-file=""
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436949    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436952    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436956    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436962    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436965    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436967    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436970    2573 flags.go:64] FLAG: --logging-format="text"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436973    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436976    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436979    2573 flags.go:64] FLAG: --manifest-url=""
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436982    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436986    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436991    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436995    2573 flags.go:64] FLAG: --max-pods="110"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.436998    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437000    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437003    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437006    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437009    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 06:54:39.442590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437012    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437015    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437023    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437026    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437029    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437032    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437035    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437040    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437043    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437047    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437049    2573 flags.go:64] FLAG: --port="10250"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437052    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437055    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b83f4f17b05c164a"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437059    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437062    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437065    2573 flags.go:64] FLAG: --register-node="true"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437068    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437072    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437075    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437077    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437080    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437084    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437086    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437089    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437092    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 06:54:39.443226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437096    2573 flags.go:64] FLAG: --runonce="false"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437099    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437102    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437105    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437108    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437110    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437114    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437117    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437120    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437123    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437126    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437128    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437131    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437134    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437137    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437140    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437145    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437147    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437150    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437154    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437157    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437159    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437162    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437167    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437170    2573 flags.go:64] FLAG: --v="2"
Jul 08 06:54:39.443923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437174    2573 flags.go:64] FLAG: --version="false"
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437177    2573 flags.go:64] FLAG: --vmodule=""
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437181    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.437185    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437298    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437303    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437307    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437311    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437314    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437317    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437320    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437323    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437325    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437328    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437331    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437333    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437336    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437339    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437341    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437344    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:54:39.444534 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437346    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437349    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437352    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437354    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437357    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437360    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437362    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437365    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437367    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437370    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437374    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437376    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437379    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437381    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437384    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437386    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437389    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437392    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437395    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437399    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437401    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:54:39.445033 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437404    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437406    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437409    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437411    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437414    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437416    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437420    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437424    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437427    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437429    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437432    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437434    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437437    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437439    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437442    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437445    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437447    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437450    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437452    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:54:39.445595 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437455    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437458    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437463    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437466    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437470    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437473    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437475    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437478    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437481    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437484    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437488    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437492    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437495    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437498    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437500    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437503    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437506    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437508    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437511    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:54:39.446072 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437514    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437516    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437519    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437521    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437524    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437527    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437529    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437532    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437534    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437537    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437539    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437542    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437544    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437547    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437549    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437554    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437557    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437559    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437562    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437564    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:54:39.446542 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437567    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437569    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437572    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.437574    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.438242    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.445683    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.445701    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.445722    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.445731    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445814    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445820    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445825    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445827    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445831    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:54:39.447045 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445834    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445837    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445840    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445844    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445847    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445850    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445853    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445856    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445859    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445862    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445865    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445868    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445871    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445874    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445877    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445880    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445883    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445885    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445888    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:54:39.447401 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445892    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445894    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445897    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445900    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445902    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445912    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445915    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445917    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445920    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445922    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445925    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445927    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445930    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445932    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445934    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445937    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445940    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445942    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445945    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445948    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:54:39.447868 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445950    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445953    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445957    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445961    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445963    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445966    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445968    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445971    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445973    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445976    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445978    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445981    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445983    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445986    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445988    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445991    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445994    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.445997    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446005    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:54:39.448365 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446008    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446010    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446013    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446015    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446018    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446020    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446023    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446025    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446027    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446030    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446032    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446035    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446037    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446040    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446043    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446045    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446047    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446050    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446052    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446055    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:54:39.448911 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446057    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446060    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446062    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446065    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446067    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446070    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446073    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446075    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446079    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446081    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446084    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446087    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446095    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446098    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446100    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:54:39.449396 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446103    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.446108    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446278    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446283    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446287    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446289    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446292    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446295    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446297    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446300    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446302    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446305    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446307    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446310    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446312    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:54:39.449784 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446315    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446317    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446320    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446322    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446325    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446327    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446330    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446333    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446335    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446338    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446341    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446343    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446346    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446349    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446352    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446360    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446363    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446365    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446368    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446370    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:54:39.450169 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446372    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446375    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446377    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446385    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446388    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446390    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446393    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446395    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446398    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446402    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446405    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446408    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446410    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446413    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446415    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446418    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446422    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446425    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446428    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:54:39.450655 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446431    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446433    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446436    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446438    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446441    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446443    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446446    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446448    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446451    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446458    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446461    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446463    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446466    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446469    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446471    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446473    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446477    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446480    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446483    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:54:39.451146 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446486    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446488    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446490    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446493    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446495    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446497    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446500    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446502    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446505    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446507    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446510    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446513    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446515    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446518    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446520    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446523    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446525    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446528    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446530    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:54:39.451600 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446532    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446535    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446537    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446540    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446549    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446552    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446555    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446558    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:39.446560    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.446565    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.446709    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.449135    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.450838    2573 server.go:1019] "Starting client certificate rotation"
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.450940    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 06:54:39.452075 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.450971    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 06:54:39.455465 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.455413    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 06:54:39.457266 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.457240    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 06:54:39.467189 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.467170    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 08 06:54:39.469617 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.469601    2573 log.go:25] "Validated CRI v1 image API"
Jul 08 06:54:39.472083 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.472065    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 06:54:39.476927 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.476901    2573 fs.go:135] Filesystem UUIDs: map[093cf0f0-2bb3-4784-8d84-39646817b6fb:/dev/nvme0n1p3 3d070cc7-1b1f-48c6-a666-6156a3502cb6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 08 06:54:39.476994 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.476925    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 06:54:39.483491 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.483379    2573 manager.go:216] Machine: {Timestamp:2026-07-08 06:54:39.482004559 +0000 UTC m=+0.366551480 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098765 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec288ce3af52e2fdcd315170e17abce0 SystemUUID:ec288ce3-af52-e2fd-cd31-5170e17abce0 BootID:a2bcf2a3-3971-4add-b496-1ba27c4cec8b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:fa:ec:c1:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:fa:ec:c1:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:fe:e5:89:f5:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 06:54:39.483491 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.483483    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 06:54:39.483609 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.483563    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 06:54:39.487145 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.487109    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 06:54:39.487281 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.487145    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 06:54:39.488648 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.488632    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 06:54:39.488648 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.488647    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 06:54:39.488826 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.488655    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 06:54:39.489531 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.489385    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 06:54:39.491369 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.491357    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 06:54:39.495795 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.495776    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 06:54:39.496041 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496029    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 06:54:39.496166 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496156    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 06:54:39.496200 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496188    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 06:54:39.496200 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496199    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 06:54:39.496252 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496214    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 06:54:39.496252 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496223    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 08 06:54:39.496252 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496232    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 06:54:39.496653 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496641    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 06:54:39.496687 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.496660    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 06:54:39.499144 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.499122    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 06:54:39.502829 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.502811    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 06:54:39.502907 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.502844    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 06:54:39.504218 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504205    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 06:54:39.504218 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504221    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504228    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504234    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504242    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504248    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504255    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504260    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504267    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504272    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504281    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 06:54:39.504340 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.504295    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 06:54:39.505047 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.505024    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 06:54:39.505131 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.505067    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 06:54:39.505196 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.505134    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 06:54:39.505196 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.505148    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 06:54:39.508458 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.508445    2573 server.go:1268] "Started kubelet"
Jul 08 06:54:39.509015 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.508763    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 06:54:39.509015 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.508809    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 06:54:39.509237 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.509208    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 06:54:39.509487 ip-10-0-136-129 systemd[1]: Started Kubernetes Kubelet.
Jul 08 06:54:39.510533 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.510523    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 06:54:39.510910 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.510881    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 06:54:39.513482 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.513467    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 06:54:39.513871 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.513852    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 06:54:39.515427 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.514287    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-129.ec2.internal.18c03e0d5a40dd11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-129.ec2.internal,UID:ip-10-0-136-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-129.ec2.internal,},FirstTimestamp:2026-07-08 06:54:39.508413713 +0000 UTC m=+0.392960817,LastTimestamp:2026-07-08 06:54:39.508413713 +0000 UTC m=+0.392960817,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-129.ec2.internal,}"
Jul 08 06:54:39.521809 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.521791    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 06:54:39.521809 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.521805    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 06:54:39.521943 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.521894    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:39.522566 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522548    2573 factory.go:55] Registering systemd factory
Jul 08 06:54:39.522566 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522568    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 08 06:54:39.522699 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522578    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 06:54:39.522699 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522596    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 06:54:39.522699 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522580    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 06:54:39.522848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522703    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 06:54:39.522848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522710    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 06:54:39.522848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522797    2573 factory.go:153] Registering CRI-O factory
Jul 08 06:54:39.522848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522808    2573 factory.go:223] Registration of the crio container factory successfully
Jul 08 06:54:39.522988 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522859    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 06:54:39.522988 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522877    2573 factory.go:103] Registering Raw factory
Jul 08 06:54:39.522988 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.522887    2573 manager.go:1196] Started watching for new ooms in manager
Jul 08 06:54:39.523497 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.523482    2573 manager.go:349] Starting recovery of all containers
Jul 08 06:54:39.524232 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.524197    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 06:54:39.524340 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.524274    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 06:54:39.524841 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.524813    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdr78"
Jul 08 06:54:39.534491 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.534274    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdr78"
Jul 08 06:54:39.535375 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.535353    2573 manager.go:354] Recovery completed
Jul 08 06:54:39.540212 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.540198    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:54:39.542143 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.542128    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:54:39.542192 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.542159    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:54:39.542192 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.542171    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:54:39.542803 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.542783    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 06:54:39.542803 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.542802    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 06:54:39.542949 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.542790    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:54:39.542949 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.542822    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 06:54:39.543556 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.543543    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:54:39.543597 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.543570    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:54:39.543597 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.543584    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:54:39.544820 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.544805    2573 policy_none.go:49] "None policy: Start"
Jul 08 06:54:39.544885 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.544823    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 06:54:39.544885 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.544834    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 06:54:39.546797 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.546785    2573 policy_none.go:47] "Start"
Jul 08 06:54:39.589406 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.589387    2573 manager.go:337] "Starting Device Plugin manager"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.589423    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.589436    2573 server.go:87] "Starting device plugin registration server"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.589755    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.589772    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.589838    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.589914    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.589924    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.590501    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 06:54:39.606926 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.590556    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:39.624447 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.624416    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 06:54:39.625828 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.625801    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 06:54:39.625933 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.625850    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 06:54:39.625933 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.625888    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 06:54:39.625933 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.625924    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 06:54:39.628431 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.628394    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:54:39.690720 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.690619    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:54:39.692323 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.692304    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:54:39.692431 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.692340    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:54:39.692431 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.692354    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:54:39.692431 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.692383    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.700953 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.700936    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.701035 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.700962    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-129.ec2.internal\": node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:39.720015 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.719989    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:39.726346 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.726324    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"]
Jul 08 06:54:39.726414 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.726390    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:54:39.727366 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.727350    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:54:39.727465 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.727383    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:54:39.727465 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.727396    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:54:39.729973 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.729958    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:54:39.730086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.730129 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730102    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:54:39.730687 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730671    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:54:39.730687 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730681    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:54:39.730891 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730700    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:54:39.730891 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730703    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:54:39.730891 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730716    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:54:39.730891 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.730714    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:54:39.733113 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.733096    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.733205 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.733127    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:54:39.733870 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.733852    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:54:39.733945 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.733881    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:54:39.733945 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.733891    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:54:39.752475 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.752450    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-129.ec2.internal\" not found" node="ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.757030 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.757012    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-129.ec2.internal\" not found" node="ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.820466 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:39.820435    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:39.823268 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.823250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ad9c2c70c8c6d94cfad6526a2252f5d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"3ad9c2c70c8c6d94cfad6526a2252f5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.823335 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.823278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad9c2c70c8c6d94cfad6526a2252f5d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"3ad9c2c70c8c6d94cfad6526a2252f5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:39.823335 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:39.823296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7d9af3fb9e5661f42d636439856e61e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-129.ec2.internal\" (UID: \"a7d9af3fb9e5661f42d636439856e61e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.110077 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.110047    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:41.113315 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.113293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ad9c2c70c8c6d94cfad6526a2252f5d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"3ad9c2c70c8c6d94cfad6526a2252f5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.113364 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.113324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad9c2c70c8c6d94cfad6526a2252f5d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"3ad9c2c70c8c6d94cfad6526a2252f5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.113364 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.113343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7d9af3fb9e5661f42d636439856e61e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-129.ec2.internal\" (UID: \"a7d9af3fb9e5661f42d636439856e61e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.113424 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.113377    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7d9af3fb9e5661f42d636439856e61e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-129.ec2.internal\" (UID: \"a7d9af3fb9e5661f42d636439856e61e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.113424 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.113396    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ad9c2c70c8c6d94cfad6526a2252f5d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"3ad9c2c70c8c6d94cfad6526a2252f5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.113485 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.113405    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad9c2c70c8c6d94cfad6526a2252f5d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal\" (UID: \"3ad9c2c70c8c6d94cfad6526a2252f5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.210813 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.210723    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:41.245128 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.245101    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.249073 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.249050    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.310902 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.310862    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:41.411342 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.411306    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:41.511854 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.511756    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-129.ec2.internal\" not found"
Jul 08 06:54:41.545062 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.545040    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:54:41.611361 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.611330    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.624621 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.624596    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 06:54:41.626170 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.626152    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal"
Jul 08 06:54:41.636610 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.636586    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 06:54:41.639328 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.639311    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 06:54:41.639475 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.639457    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 06:54:41.639522 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.639472    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 06:54:41.685635 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.685609    2573 apiserver.go:52] "Watching apiserver"
Jul 08 06:54:41.703020 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.702996    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 06:54:41.704921 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.704465    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-9qn8n","openshift-multus/multus-additional-cni-plugins-s2j4q","openshift-network-diagnostics/network-check-target-tttrr","kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg","openshift-cluster-node-tuning-operator/tuned-p5k4w","openshift-image-registry/node-ca-gs6tq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal","openshift-multus/network-metrics-daemon-k6qlq","openshift-network-operator/iptables-alerter-t2jjk","openshift-ovn-kubernetes/ovnkube-node-vftkn","kube-system/global-pull-secret-syncer-hqdlr","kube-system/konnectivity-agent-sshz7","openshift-dns/node-resolver-vv587"]
Jul 08 06:54:41.707071 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.707048    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.709342 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.709298    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 06:54:41.709456 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.709352    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 06:54:41.709456 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.709434    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:54:41.709563 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.709537    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-76mjg\""
Jul 08 06:54:41.709774 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.709733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.711194 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.711178    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 06:54:41.711789 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.711751    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 06:54:41.711871 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.711824    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 06:54:41.712110 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.712097    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.712470 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.712455    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 06:54:41.712587 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.712574    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 06:54:41.712840 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.712828    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4lg2s\""
Jul 08 06:54:41.712878 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.712843    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 06:54:41.712919 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.712881    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 06:54:41.714253 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.714236    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 06:54:41.714321 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.714258    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 06:54:41.714321 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.714313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8v7ct\""
Jul 08 06:54:41.714424 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.714411    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 06:54:41.715205 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715191    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.715462 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715529 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfncf\" (UniqueName: \"kubernetes.io/projected/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-kube-api-access-dfncf\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.715529 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-systemd-units\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715529 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-etc-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715616 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-cni-netd\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715616 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-env-overrides\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715616 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-systemd\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715702 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-run-ovn-kubernetes\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715702 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovn-node-metrics-cert\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715702 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-iptables-alerter-script\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.715702 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-cni-bin\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715702 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovnkube-config\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovnkube-script-lib\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-host\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-kubelet\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-slash\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-run-netns\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thwtt\" (UniqueName: \"kubernetes.io/projected/f1cce830-1e29-4969-bc0c-c79eda08cf00-kube-api-access-thwtt\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-serviceca\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-node-log\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.715875 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-log-socket\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.716115 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-host-slash\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.716115 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.716115 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-var-lib-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.716115 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffms8\" (UniqueName: \"kubernetes.io/projected/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-kube-api-access-ffms8\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.716115 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.715979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-ovn\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.717228 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.717211    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 06:54:41.717298 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.717234    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 06:54:41.717298 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.717245    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 06:54:41.717407 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.717346    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hs7f5\""
Jul 08 06:54:41.717407 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.717397    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 06:54:41.717864 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.717849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.719992 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.719976    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7jfv\""
Jul 08 06:54:41.720130 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.720115    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 06:54:41.720198 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.720151    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 06:54:41.720552 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.720539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.722405 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.722387    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:54:41.722499 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.722485    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w95z2\""
Jul 08 06:54:41.722540 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.722506    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 06:54:41.723158 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.723138    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:41.725498 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.725467    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 06:54:41.725648 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.725524    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hp5zz\""
Jul 08 06:54:41.725648 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.725534    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 06:54:41.725648 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.725525    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 06:54:41.725926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.725910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:41.726030 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.726005    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:41.726408 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.726382    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 06:49:40 +0000 UTC" deadline="2028-03-17 08:24:12.77862639 +0000 UTC"
Jul 08 06:54:41.726408 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.726407    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14833h29m31.052222331s"
Jul 08 06:54:41.728538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.728521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.730672 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.730655    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 06:54:41.730818 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.730797    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 06:54:41.731027 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.731010    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-twm4w\""
Jul 08 06:54:41.731229 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.731213    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 06:54:41.731229 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.731225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:41.731342 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.731269    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:41.735732 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.735702    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.735850 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.735810    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:41.738360 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.738339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.740496 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.740476    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 06:54:41.740496 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.740489    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-snv62\""
Jul 08 06:54:41.740633 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.740616    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 06:54:41.749712 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.749697    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xdlnx"
Jul 08 06:54:41.755147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.755128    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xdlnx"
Jul 08 06:54:41.812900 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.812878    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 06:54:41.816250 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-daemon-config\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.816354 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:41.816354 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.816354 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-hostroot\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.816354 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.816524 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816376    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.816524 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ccb06c-4210-4f1f-956e-3087d74bbda5-tmp\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.816524 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-var-lib-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.816524 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffms8\" (UniqueName: \"kubernetes.io/projected/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-kube-api-access-ffms8\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-registration-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816556    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-var-lib-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816551    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-etc-selinux\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-ovn\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0389afe8-f7d2-4543-93fd-03bbf7b422a5-hosts-file\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-system-cni-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-cnibin\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4575f08e-0a3d-4124-962b-43eec74a3a43-agent-certs\") pod \"konnectivity-agent-sshz7\" (UID: \"4575f08e-0a3d-4124-962b-43eec74a3a43\") " pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:41.816711 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816679    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-ovn\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816733    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816783    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816807    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-sys-fs\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfncf\" (UniqueName: \"kubernetes.io/projected/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-kube-api-access-dfncf\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-etc-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-env-overrides\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-k8s-cni-cncf-io\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816920    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-etc-openvswitch\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.816957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-cni-bin\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp46l\" (UniqueName: \"kubernetes.io/projected/8b7f7016-2c27-4336-9186-a4d747454693-kube-api-access-pp46l\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-modprobe-d\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysctl-conf\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-run-ovn-kubernetes\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-cni-multus\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qh52\" (UniqueName: \"kubernetes.io/projected/1a7f895e-9a70-462d-9003-e36e15b73099-kube-api-access-2qh52\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.817147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817151    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysctl-d\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-systemd\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817194    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-run-ovn-kubernetes\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-iptables-alerter-script\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-cni-bin\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-cnibin\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817265    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-cni-bin\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817267    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-sys\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817370    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-env-overrides\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-kubelet\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817407    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-kubelet\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-run-netns\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thwtt\" (UniqueName: \"kubernetes.io/projected/f1cce830-1e29-4969-bc0c-c79eda08cf00-kube-api-access-thwtt\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-cni-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7120c08e-40e2-4de6-a9fb-0977b918782d-cni-binary-copy\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817516    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-run-netns\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.817790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-conf-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-run\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-log-socket\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817660    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-iptables-alerter-script\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/afe5e80d-238d-47b2-8461-4df860065087-kubelet-config\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-lib-modules\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817705    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-log-socket\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-host-slash\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/afe5e80d-238d-47b2-8461-4df860065087-dbus\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817793    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-host-slash\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q49rg\" (UniqueName: \"kubernetes.io/projected/0389afe8-f7d2-4543-93fd-03bbf7b422a5-kube-api-access-q49rg\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-multus-certs\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-kubernetes\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.818343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-os-release\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-kubelet\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817976    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.817983    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-etc-kubernetes\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4575f08e-0a3d-4124-962b-43eec74a3a43-konnectivity-ca\") pod \"konnectivity-agent-sshz7\" (UID: \"4575f08e-0a3d-4124-962b-43eec74a3a43\") " pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-host\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlxp7\" (UniqueName: \"kubernetes.io/projected/1d381a0a-c35f-467f-a39f-22f29768eeea-kube-api-access-hlxp7\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-systemd-units\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-cni-netd\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818121    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-systemd-units\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0389afe8-f7d2-4543-93fd-03bbf7b422a5-tmp-dir\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818141    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-cni-netd\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-socket-dir-parent\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb9ss\" (UniqueName: \"kubernetes.io/projected/7120c08e-40e2-4de6-a9fb-0977b918782d-kube-api-access-sb9ss\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysconfig\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-systemd\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovn-node-metrics-cert\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-netns\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-system-cni-dir\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818244    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-run-systemd\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovnkube-config\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovnkube-script-lib\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-host\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-os-release\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818392    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-host\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818393    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-var-lib-kubelet\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-tuned\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7q45\" (UniqueName: \"kubernetes.io/projected/a8ccb06c-4210-4f1f-956e-3087d74bbda5-kube-api-access-j7q45\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-slash\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-serviceca\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-socket-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-device-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818554    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 06:54:41.819538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818565    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-host-slash\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.820043 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-node-log\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.820043 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818632    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1cce830-1e29-4969-bc0c-c79eda08cf00-node-log\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.820043 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818800    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovnkube-config\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.820043 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818872    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovnkube-script-lib\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.820043 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.818935    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-serviceca\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.821414 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.821394    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1cce830-1e29-4969-bc0c-c79eda08cf00-ovn-node-metrics-cert\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.827387 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.827359    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffms8\" (UniqueName: \"kubernetes.io/projected/ba6d7dae-f54d-49da-a43e-7623d1e7ce64-kube-api-access-ffms8\") pod \"node-ca-gs6tq\" (UID: \"ba6d7dae-f54d-49da-a43e-7623d1e7ce64\") " pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:41.827518 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.827468    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfncf\" (UniqueName: \"kubernetes.io/projected/385aa6f4-6a59-41a9-9f86-2e1294f62a3a-kube-api-access-dfncf\") pod \"iptables-alerter-t2jjk\" (UID: \"385aa6f4-6a59-41a9-9f86-2e1294f62a3a\") " pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:41.827980 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.827961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thwtt\" (UniqueName: \"kubernetes.io/projected/f1cce830-1e29-4969-bc0c-c79eda08cf00-kube-api-access-thwtt\") pod \"ovnkube-node-vftkn\" (UID: \"f1cce830-1e29-4969-bc0c-c79eda08cf00\") " pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:41.885883 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:41.885849    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad9c2c70c8c6d94cfad6526a2252f5d.slice/crio-b98c4720e351d9073d79b69a5690dbd00230b5abc42827b9f32b897d58da7e36 WatchSource:0}: Error finding container b98c4720e351d9073d79b69a5690dbd00230b5abc42827b9f32b897d58da7e36: Status 404 returned error can't find the container with id b98c4720e351d9073d79b69a5690dbd00230b5abc42827b9f32b897d58da7e36
Jul 08 06:54:41.896446 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.896426    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 06:54:41.906387 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:41.906353    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d9af3fb9e5661f42d636439856e61e.slice/crio-170717cdd8ca43af10267c3abcc21c6c010db8f8b955d7a29192472b4d72d4fd WatchSource:0}: Error finding container 170717cdd8ca43af10267c3abcc21c6c010db8f8b955d7a29192472b4d72d4fd: Status 404 returned error can't find the container with id 170717cdd8ca43af10267c3abcc21c6c010db8f8b955d7a29192472b4d72d4fd
Jul 08 06:54:41.919785 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q49rg\" (UniqueName: \"kubernetes.io/projected/0389afe8-f7d2-4543-93fd-03bbf7b422a5-kube-api-access-q49rg\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.919919 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-multus-certs\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.919919 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.919919 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-kubernetes\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.919919 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919882    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-kubernetes\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.919919 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919878    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-multus-certs\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.919919 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-os-release\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-kubelet\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-etc-kubernetes\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4575f08e-0a3d-4124-962b-43eec74a3a43-konnectivity-ca\") pod \"konnectivity-agent-sshz7\" (UID: \"4575f08e-0a3d-4124-962b-43eec74a3a43\") " pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.919985    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.919991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-host\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlxp7\" (UniqueName: \"kubernetes.io/projected/1d381a0a-c35f-467f-a39f-22f29768eeea-kube-api-access-hlxp7\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0389afe8-f7d2-4543-93fd-03bbf7b422a5-tmp-dir\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920040    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-etc-kubernetes\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920059    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-os-release\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.920081    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret podName:afe5e80d-238d-47b2-8461-4df860065087 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:42.420051466 +0000 UTC m=+2.115572345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret") pod "global-pull-secret-syncer-hqdlr" (UID: "afe5e80d-238d-47b2-8461-4df860065087") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920095    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-host\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920041    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-kubelet\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-socket-dir-parent\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb9ss\" (UniqueName: \"kubernetes.io/projected/7120c08e-40e2-4de6-a9fb-0977b918782d-kube-api-access-sb9ss\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-socket-dir-parent\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysconfig\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.920297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-netns\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-system-cni-dir\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-os-release\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920294    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-netns\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-var-lib-kubelet\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920320    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-system-cni-dir\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920340    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0389afe8-f7d2-4543-93fd-03bbf7b422a5-tmp-dir\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920358    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-var-lib-kubelet\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920369    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysconfig\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-tuned\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7q45\" (UniqueName: \"kubernetes.io/projected/a8ccb06c-4210-4f1f-956e-3087d74bbda5-kube-api-access-j7q45\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920430    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-os-release\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-socket-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920466    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-device-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-daemon-config\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920527    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-socket-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.921086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920550    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4575f08e-0a3d-4124-962b-43eec74a3a43-konnectivity-ca\") pod \"konnectivity-agent-sshz7\" (UID: \"4575f08e-0a3d-4124-962b-43eec74a3a43\") " pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-hostroot\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.920587    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920589    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-device-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920599    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-hostroot\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.920642    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs podName:8b7f7016-2c27-4336-9186-a4d747454693 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:42.420617104 +0000 UTC m=+2.116137966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs") pod "network-metrics-daemon-k6qlq" (UID: "8b7f7016-2c27-4336-9186-a4d747454693") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ccb06c-4210-4f1f-956e-3087d74bbda5-tmp\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-registration-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-etc-selinux\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0389afe8-f7d2-4543-93fd-03bbf7b422a5-hosts-file\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-system-cni-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-cnibin\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4575f08e-0a3d-4124-962b-43eec74a3a43-agent-certs\") pod \"konnectivity-agent-sshz7\" (UID: \"4575f08e-0a3d-4124-962b-43eec74a3a43\") " pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920869    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0389afe8-f7d2-4543-93fd-03bbf7b422a5-hosts-file\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.922016 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-sys-fs\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-k8s-cni-cncf-io\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920828    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-registration-dir\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.920989    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-system-cni-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921016    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-cnibin\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921027    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-run-k8s-cni-cncf-io\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921043    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-etc-selinux\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921092    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d381a0a-c35f-467f-a39f-22f29768eeea-sys-fs\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921092    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-cni-bin\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp46l\" (UniqueName: \"kubernetes.io/projected/8b7f7016-2c27-4336-9186-a4d747454693-kube-api-access-pp46l\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921176    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921186    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-modprobe-d\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921222    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-cni-bin\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysctl-conf\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.922863 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921239    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-daemon-config\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-cni-multus\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921287    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-modprobe-d\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qh52\" (UniqueName: \"kubernetes.io/projected/1a7f895e-9a70-462d-9003-e36e15b73099-kube-api-access-2qh52\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysctl-d\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-systemd\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-cnibin\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921429    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysctl-conf\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-sys\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-cni-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7120c08e-40e2-4de6-a9fb-0977b918782d-cni-binary-copy\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-conf-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-sysctl-d\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-run\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-host-var-lib-cni-multus\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:41.923464 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/afe5e80d-238d-47b2-8461-4df860065087-kubelet-config\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-lib-modules\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/afe5e80d-238d-47b2-8461-4df860065087-dbus\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-sys\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921916    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-cni-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921947    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7120c08e-40e2-4de6-a9fb-0977b918782d-multus-conf-dir\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921965    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/afe5e80d-238d-47b2-8461-4df860065087-dbus\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921967    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a7f895e-9a70-462d-9003-e36e15b73099-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.921970    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-run\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.922007    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/afe5e80d-238d-47b2-8461-4df860065087-kubelet-config\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.922024    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a7f895e-9a70-462d-9003-e36e15b73099-cnibin\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.922035    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-systemd\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.922134    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8ccb06c-4210-4f1f-956e-3087d74bbda5-lib-modules\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.922361    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7120c08e-40e2-4de6-a9fb-0977b918782d-cni-binary-copy\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.923065    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8ccb06c-4210-4f1f-956e-3087d74bbda5-etc-tuned\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.923234    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4575f08e-0a3d-4124-962b-43eec74a3a43-agent-certs\") pod \"konnectivity-agent-sshz7\" (UID: \"4575f08e-0a3d-4124-962b-43eec74a3a43\") " pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:41.923950 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.923285    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ccb06c-4210-4f1f-956e-3087d74bbda5-tmp\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.932056 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.932031    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:54:41.932169 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.932086    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:54:41.932169 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.932102    2573 projected.go:196] Error preparing data for projected volume kube-api-access-srlfx for pod openshift-network-diagnostics/network-check-target-tttrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:41.932252 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:41.932205    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx podName:9ab05bfd-e233-4096-a9e6-740d0c1eec10 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:42.432186197 +0000 UTC m=+2.127707079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-srlfx" (UniqueName: "kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx") pod "network-check-target-tttrr" (UID: "9ab05bfd-e233-4096-a9e6-740d0c1eec10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:41.933622 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.933597    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qh52\" (UniqueName: \"kubernetes.io/projected/1a7f895e-9a70-462d-9003-e36e15b73099-kube-api-access-2qh52\") pod \"multus-additional-cni-plugins-s2j4q\" (UID: \"1a7f895e-9a70-462d-9003-e36e15b73099\") " pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:41.933733 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.933667    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q49rg\" (UniqueName: \"kubernetes.io/projected/0389afe8-f7d2-4543-93fd-03bbf7b422a5-kube-api-access-q49rg\") pod \"node-resolver-vv587\" (UID: \"0389afe8-f7d2-4543-93fd-03bbf7b422a5\") " pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:41.933836 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.933813    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7q45\" (UniqueName: \"kubernetes.io/projected/a8ccb06c-4210-4f1f-956e-3087d74bbda5-kube-api-access-j7q45\") pod \"tuned-p5k4w\" (UID: \"a8ccb06c-4210-4f1f-956e-3087d74bbda5\") " pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:41.934843 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.934816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb9ss\" (UniqueName: \"kubernetes.io/projected/7120c08e-40e2-4de6-a9fb-0977b918782d-kube-api-access-sb9ss\") pod \"multus-9qn8n\" (UID: \"7120c08e-40e2-4de6-a9fb-0977b918782d\") " pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:41.935351 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.935331    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp46l\" (UniqueName: \"kubernetes.io/projected/8b7f7016-2c27-4336-9186-a4d747454693-kube-api-access-pp46l\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:41.935459 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.935444    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlxp7\" (UniqueName: \"kubernetes.io/projected/1d381a0a-c35f-467f-a39f-22f29768eeea-kube-api-access-hlxp7\") pod \"aws-ebs-csi-driver-node-rswkg\" (UID: \"1d381a0a-c35f-467f-a39f-22f29768eeea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:41.997620 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:41.997586    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:54:42.033411 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.033333    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t2jjk"
Jul 08 06:54:42.043668 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.043644    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385aa6f4_6a59_41a9_9f86_2e1294f62a3a.slice/crio-b827c7507ed26b51d1a22398f07f08236c144df4db03056a920a061c6deaa139 WatchSource:0}: Error finding container b827c7507ed26b51d1a22398f07f08236c144df4db03056a920a061c6deaa139: Status 404 returned error can't find the container with id b827c7507ed26b51d1a22398f07f08236c144df4db03056a920a061c6deaa139
Jul 08 06:54:42.048837 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.048818    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:54:42.056733 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.056708    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cce830_1e29_4969_bc0c_c79eda08cf00.slice/crio-148a90289f81999fe79b47ef313b1361c358e99a02e7773c1ef3410e2f160b47 WatchSource:0}: Error finding container 148a90289f81999fe79b47ef313b1361c358e99a02e7773c1ef3410e2f160b47: Status 404 returned error can't find the container with id 148a90289f81999fe79b47ef313b1361c358e99a02e7773c1ef3410e2f160b47
Jul 08 06:54:42.065100 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.065076    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gs6tq"
Jul 08 06:54:42.074119 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.074094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6d7dae_f54d_49da_a43e_7623d1e7ce64.slice/crio-2c4d401ee626c6dadde0f0e7e4ee4953904a82d703023b1ce14c9ebf1cbb918c WatchSource:0}: Error finding container 2c4d401ee626c6dadde0f0e7e4ee4953904a82d703023b1ce14c9ebf1cbb918c: Status 404 returned error can't find the container with id 2c4d401ee626c6dadde0f0e7e4ee4953904a82d703023b1ce14c9ebf1cbb918c
Jul 08 06:54:42.084344 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.084321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9qn8n"
Jul 08 06:54:42.091160 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.091131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2j4q"
Jul 08 06:54:42.094292 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.094268    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7120c08e_40e2_4de6_a9fb_0977b918782d.slice/crio-b3b53056cc298a39775c134e5fac798fcd5e9fdeeaccf7607e6655ba514f1af0 WatchSource:0}: Error finding container b3b53056cc298a39775c134e5fac798fcd5e9fdeeaccf7607e6655ba514f1af0: Status 404 returned error can't find the container with id b3b53056cc298a39775c134e5fac798fcd5e9fdeeaccf7607e6655ba514f1af0
Jul 08 06:54:42.099345 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.099322    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7f895e_9a70_462d_9003_e36e15b73099.slice/crio-0deb92569e48d83834838c87e47d98a91346f85b83750463a52541a82974d171 WatchSource:0}: Error finding container 0deb92569e48d83834838c87e47d98a91346f85b83750463a52541a82974d171: Status 404 returned error can't find the container with id 0deb92569e48d83834838c87e47d98a91346f85b83750463a52541a82974d171
Jul 08 06:54:42.106712 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.106692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p5k4w"
Jul 08 06:54:42.115591 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.115571    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ccb06c_4210_4f1f_956e_3087d74bbda5.slice/crio-fe9a287a48931fdf2bbc2f540710dfe409169c1fdbae867865cae22454a5fd95 WatchSource:0}: Error finding container fe9a287a48931fdf2bbc2f540710dfe409169c1fdbae867865cae22454a5fd95: Status 404 returned error can't find the container with id fe9a287a48931fdf2bbc2f540710dfe409169c1fdbae867865cae22454a5fd95
Jul 08 06:54:42.125793 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.125752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:54:42.134364 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.134342    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4575f08e_0a3d_4124_962b_43eec74a3a43.slice/crio-912d9fd67b9b027d7fd9684d432d326fb08786c7f8c04422dbeaaa664dc9257c WatchSource:0}: Error finding container 912d9fd67b9b027d7fd9684d432d326fb08786c7f8c04422dbeaaa664dc9257c: Status 404 returned error can't find the container with id 912d9fd67b9b027d7fd9684d432d326fb08786c7f8c04422dbeaaa664dc9257c
Jul 08 06:54:42.149630 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.149604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg"
Jul 08 06:54:42.157536 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.157517    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vv587"
Jul 08 06:54:42.158937 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.158911    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d381a0a_c35f_467f_a39f_22f29768eeea.slice/crio-7e79c28ae1d1dec53127f680614df6d97bbe0975e91e463015cbfb3f521d1dc2 WatchSource:0}: Error finding container 7e79c28ae1d1dec53127f680614df6d97bbe0975e91e463015cbfb3f521d1dc2: Status 404 returned error can't find the container with id 7e79c28ae1d1dec53127f680614df6d97bbe0975e91e463015cbfb3f521d1dc2
Jul 08 06:54:42.167018 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:54:42.166996    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0389afe8_f7d2_4543_93fd_03bbf7b422a5.slice/crio-0b232ec3b376d1e164762dc24568d2b8eebfb2b770bbdbe703d8c54b0ed06ac7 WatchSource:0}: Error finding container 0b232ec3b376d1e164762dc24568d2b8eebfb2b770bbdbe703d8c54b0ed06ac7: Status 404 returned error can't find the container with id 0b232ec3b376d1e164762dc24568d2b8eebfb2b770bbdbe703d8c54b0ed06ac7
Jul 08 06:54:42.170343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.170325    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:54:42.424098 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.424021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:42.424247 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.424116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:42.424247 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.424188    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:42.424247 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.424240    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:42.424397 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.424263    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs podName:8b7f7016-2c27-4336-9186-a4d747454693 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:43.424242858 +0000 UTC m=+3.119763720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs") pod "network-metrics-daemon-k6qlq" (UID: "8b7f7016-2c27-4336-9186-a4d747454693") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:42.424397 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.424294    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret podName:afe5e80d-238d-47b2-8461-4df860065087 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:43.424278699 +0000 UTC m=+3.119799561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret") pod "global-pull-secret-syncer-hqdlr" (UID: "afe5e80d-238d-47b2-8461-4df860065087") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:42.525077 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.525041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:42.525266 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.525244    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:54:42.525266 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.525265    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:54:42.525397 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.525279    2573 projected.go:196] Error preparing data for projected volume kube-api-access-srlfx for pod openshift-network-diagnostics/network-check-target-tttrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:42.525397 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:42.525344    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx podName:9ab05bfd-e233-4096-a9e6-740d0c1eec10 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:43.525325734 +0000 UTC m=+3.220846597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-srlfx" (UniqueName: "kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx") pod "network-check-target-tttrr" (UID: "9ab05bfd-e233-4096-a9e6-740d0c1eec10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:42.758665 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.758572    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 06:49:41 +0000 UTC" deadline="2027-12-26 18:48:33.85284835 +0000 UTC"
Jul 08 06:54:42.758665 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.758611    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12875h53m51.094241707s"
Jul 08 06:54:42.769756 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.769714    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:54:42.848545 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.848478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p5k4w" event={"ID":"a8ccb06c-4210-4f1f-956e-3087d74bbda5","Type":"ContainerStarted","Data":"fe9a287a48931fdf2bbc2f540710dfe409169c1fdbae867865cae22454a5fd95"}
Jul 08 06:54:42.855556 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.855471    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerStarted","Data":"0deb92569e48d83834838c87e47d98a91346f85b83750463a52541a82974d171"}
Jul 08 06:54:42.864999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.864952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"148a90289f81999fe79b47ef313b1361c358e99a02e7773c1ef3410e2f160b47"}
Jul 08 06:54:42.870396 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.870358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" event={"ID":"3ad9c2c70c8c6d94cfad6526a2252f5d","Type":"ContainerStarted","Data":"b98c4720e351d9073d79b69a5690dbd00230b5abc42827b9f32b897d58da7e36"}
Jul 08 06:54:42.884565 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.884464    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sshz7" event={"ID":"4575f08e-0a3d-4124-962b-43eec74a3a43","Type":"ContainerStarted","Data":"912d9fd67b9b027d7fd9684d432d326fb08786c7f8c04422dbeaaa664dc9257c"}
Jul 08 06:54:42.892440 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.892399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9qn8n" event={"ID":"7120c08e-40e2-4de6-a9fb-0977b918782d","Type":"ContainerStarted","Data":"b3b53056cc298a39775c134e5fac798fcd5e9fdeeaccf7607e6655ba514f1af0"}
Jul 08 06:54:42.899749 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.899713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gs6tq" event={"ID":"ba6d7dae-f54d-49da-a43e-7623d1e7ce64","Type":"ContainerStarted","Data":"2c4d401ee626c6dadde0f0e7e4ee4953904a82d703023b1ce14c9ebf1cbb918c"}
Jul 08 06:54:42.906730 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.906689    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t2jjk" event={"ID":"385aa6f4-6a59-41a9-9f86-2e1294f62a3a","Type":"ContainerStarted","Data":"b827c7507ed26b51d1a22398f07f08236c144df4db03056a920a061c6deaa139"}
Jul 08 06:54:42.911706 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.911671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" event={"ID":"a7d9af3fb9e5661f42d636439856e61e","Type":"ContainerStarted","Data":"170717cdd8ca43af10267c3abcc21c6c010db8f8b955d7a29192472b4d72d4fd"}
Jul 08 06:54:42.924532 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.924434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vv587" event={"ID":"0389afe8-f7d2-4543-93fd-03bbf7b422a5","Type":"ContainerStarted","Data":"0b232ec3b376d1e164762dc24568d2b8eebfb2b770bbdbe703d8c54b0ed06ac7"}
Jul 08 06:54:42.933314 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:42.933271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg" event={"ID":"1d381a0a-c35f-467f-a39f-22f29768eeea","Type":"ContainerStarted","Data":"7e79c28ae1d1dec53127f680614df6d97bbe0975e91e463015cbfb3f521d1dc2"}
Jul 08 06:54:43.432187 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.431813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:43.432187 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.431909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:43.432187 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.432049    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:43.432187 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.432109    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret podName:afe5e80d-238d-47b2-8461-4df860065087 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:45.432092146 +0000 UTC m=+5.127613006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret") pod "global-pull-secret-syncer-hqdlr" (UID: "afe5e80d-238d-47b2-8461-4df860065087") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:43.432187 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.432172    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:43.432585 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.432221    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs podName:8b7f7016-2c27-4336-9186-a4d747454693 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:45.432206463 +0000 UTC m=+5.127727322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs") pod "network-metrics-daemon-k6qlq" (UID: "8b7f7016-2c27-4336-9186-a4d747454693") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:43.533089 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.533051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:43.533311 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.533282    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:54:43.533375 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.533326    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:54:43.533375 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.533340    2573 projected.go:196] Error preparing data for projected volume kube-api-access-srlfx for pod openshift-network-diagnostics/network-check-target-tttrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:43.533509 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.533397    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx podName:9ab05bfd-e233-4096-a9e6-740d0c1eec10 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:45.53338043 +0000 UTC m=+5.228901307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-srlfx" (UniqueName: "kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx") pod "network-check-target-tttrr" (UID: "9ab05bfd-e233-4096-a9e6-740d0c1eec10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:43.758893 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.758754    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 06:49:41 +0000 UTC" deadline="2028-02-20 17:01:38.372857804 +0000 UTC"
Jul 08 06:54:43.758893 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.758834    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14218h6m54.614028119s"
Jul 08 06:54:43.816095 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.816063    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:43.816332 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.816211    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:43.816754 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.816733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:43.817037 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.816850    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:43.817037 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.816919    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:43.817037 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:43.816987    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:43.938739 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:43.938709    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:54:45.446799 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:45.446214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:45.446799 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.446399    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:45.446799 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.446621    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:45.446799 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.446623    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs podName:8b7f7016-2c27-4336-9186-a4d747454693 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:49.446599792 +0000 UTC m=+9.142120658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs") pod "network-metrics-daemon-k6qlq" (UID: "8b7f7016-2c27-4336-9186-a4d747454693") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:45.446799 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.446682    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret podName:afe5e80d-238d-47b2-8461-4df860065087 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:49.446667455 +0000 UTC m=+9.142188319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret") pod "global-pull-secret-syncer-hqdlr" (UID: "afe5e80d-238d-47b2-8461-4df860065087") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:45.446799 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:45.446543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:45.547311 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:45.547274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:45.547501 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.547467    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:54:45.547501 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.547495    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:54:45.547612 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.547510    2573 projected.go:196] Error preparing data for projected volume kube-api-access-srlfx for pod openshift-network-diagnostics/network-check-target-tttrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:45.547612 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.547575    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx podName:9ab05bfd-e233-4096-a9e6-740d0c1eec10 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:49.547553393 +0000 UTC m=+9.243074270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-srlfx" (UniqueName: "kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx") pod "network-check-target-tttrr" (UID: "9ab05bfd-e233-4096-a9e6-740d0c1eec10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:45.815191 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:45.815102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:45.815345 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.815264    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:45.815923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:45.815629    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:45.815923 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.815723    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:45.815923 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:45.815784    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:45.815923 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:45.815857    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:47.816078 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:47.816043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:47.816078 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:47.816068    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:47.816605 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:47.816068    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:47.816605 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:47.816197    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:47.816605 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:47.816265    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:47.816605 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:47.816354    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:49.484028 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:49.483986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:49.484483 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:49.484055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:49.484483 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.484157    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:49.484483 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.484238    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret podName:afe5e80d-238d-47b2-8461-4df860065087 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:57.484217849 +0000 UTC m=+17.179738731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret") pod "global-pull-secret-syncer-hqdlr" (UID: "afe5e80d-238d-47b2-8461-4df860065087") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:49.484483 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.484162    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:49.484483 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.484472    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs podName:8b7f7016-2c27-4336-9186-a4d747454693 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:57.484456685 +0000 UTC m=+17.179977548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs") pod "network-metrics-daemon-k6qlq" (UID: "8b7f7016-2c27-4336-9186-a4d747454693") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:49.585227 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:49.585139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:49.585389 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.585344    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:54:49.585389 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.585373    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:54:49.585389 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.585387    2573 projected.go:196] Error preparing data for projected volume kube-api-access-srlfx for pod openshift-network-diagnostics/network-check-target-tttrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:49.585513 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.585449    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx podName:9ab05bfd-e233-4096-a9e6-740d0c1eec10 nodeName:}" failed. No retries permitted until 2026-07-08 06:54:57.585429265 +0000 UTC m=+17.280950144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-srlfx" (UniqueName: "kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx") pod "network-check-target-tttrr" (UID: "9ab05bfd-e233-4096-a9e6-740d0c1eec10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:49.815318 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:49.815251    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:49.815497 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:49.815252    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:49.815497 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.815365    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:49.815497 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:49.815252    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:49.815497 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.815462    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:49.815735 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:49.815504    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:51.815794 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:51.815744    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:51.816257 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:51.815807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:51.816257 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:51.815807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:51.816257 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:51.815901    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:51.816257 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:51.816027    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:51.816257 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:51.816125    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:53.815562 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:53.815473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:53.815562 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:53.815535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:53.816047 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:53.815473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:53.816047 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:53.815625    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:53.816047 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:53.815697    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:53.816047 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:53.815799    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:55.816099 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:55.816065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:55.816587 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:55.816065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:55.816587 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:55.816191    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:55.816587 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:55.816267    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:55.816587 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:55.816065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:55.816587 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:55.816373    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:57.542602 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:57.542512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:57.542602 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:57.542584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:57.543116 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.542693    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:57.543116 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.542702    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:57.543116 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.542756    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret podName:afe5e80d-238d-47b2-8461-4df860065087 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:13.54273652 +0000 UTC m=+33.238257382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret") pod "global-pull-secret-syncer-hqdlr" (UID: "afe5e80d-238d-47b2-8461-4df860065087") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:54:57.543116 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.542795    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs podName:8b7f7016-2c27-4336-9186-a4d747454693 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:13.542784846 +0000 UTC m=+33.238305707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs") pod "network-metrics-daemon-k6qlq" (UID: "8b7f7016-2c27-4336-9186-a4d747454693") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:54:57.643332 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:57.643292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:57.643529 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.643496    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:54:57.643529 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.643518    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:54:57.643529 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.643530    2573 projected.go:196] Error preparing data for projected volume kube-api-access-srlfx for pod openshift-network-diagnostics/network-check-target-tttrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:57.643651 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.643595    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx podName:9ab05bfd-e233-4096-a9e6-740d0c1eec10 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:13.643578951 +0000 UTC m=+33.339099835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-srlfx" (UniqueName: "kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx") pod "network-check-target-tttrr" (UID: "9ab05bfd-e233-4096-a9e6-740d0c1eec10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:54:57.815999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:57.815914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:57.815999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:57.815918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:57.816193 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.816041    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:57.816193 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:57.816055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:57.816193 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.816182    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:57.816313 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:57.816263    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:54:59.816025 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:59.815921    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:54:59.816025 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:59.815952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:54:59.816025 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:54:59.815980    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:54:59.816602 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:59.816063    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:54:59.816602 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:59.816214    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:54:59.816602 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:54:59.816296    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:01.816099 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:01.816063    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:01.816099 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:01.816089    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:01.816571 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:01.816071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:01.816571 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:01.816212    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:01.816571 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:01.816267    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:01.816571 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:01.816333    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:02.982353 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.981962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gs6tq" event={"ID":"ba6d7dae-f54d-49da-a43e-7623d1e7ce64","Type":"ContainerStarted","Data":"9733924e8f8c334da80e61f0ad9e67e3606a5f55d8e1d598e505a7e261cf842f"}
Jul 08 06:55:02.983441 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.983416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" event={"ID":"a7d9af3fb9e5661f42d636439856e61e","Type":"ContainerStarted","Data":"24f0db3ef3a1731f72fd27e3f59409942e3ecf0d97dc5fb017173b622d8fbe39"}
Jul 08 06:55:02.984781 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.984729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vv587" event={"ID":"0389afe8-f7d2-4543-93fd-03bbf7b422a5","Type":"ContainerStarted","Data":"3dc87db9296473a1d8ef5e62270bf1463aebf431e5212d4c1620bf5097f5d22c"}
Jul 08 06:55:02.986332 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.986309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg" event={"ID":"1d381a0a-c35f-467f-a39f-22f29768eeea","Type":"ContainerStarted","Data":"9b7b138b9e445ac821f5b9461aab3bd04686bd5e73d942f668f83da74854b7bd"}
Jul 08 06:55:02.987676 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.987655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p5k4w" event={"ID":"a8ccb06c-4210-4f1f-956e-3087d74bbda5","Type":"ContainerStarted","Data":"31b8054cc24d6fbe7b4ec8ed4a9b439ca130ad8ffe5082bb9e1b4eab35ccff11"}
Jul 08 06:55:02.989273 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.989252    2573 generic.go:356] "Generic (PLEG): container finished" podID="1a7f895e-9a70-462d-9003-e36e15b73099" containerID="cee64e2893e84e30d9137180727ac696d86315c1facdb3759ee04b43079aacfb" exitCode=0
Jul 08 06:55:02.989369 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.989328    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerDied","Data":"cee64e2893e84e30d9137180727ac696d86315c1facdb3759ee04b43079aacfb"}
Jul 08 06:55:02.992577 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.992554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"5ffa7ee11e0af3acbeaaae3546aeb285be6ea6c31a88e172bcfb016b07e7eec0"}
Jul 08 06:55:02.992664 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.992629    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"ed40d0cbc92d67bda80df282cb8f69a3255558813c553254a85cbdf82d0b6613"}
Jul 08 06:55:02.992723 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.992686    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"ee3682a73df100e9c67e474c7c95a42ecb44d39b10ed0cb5e43cbeddaca6812d"}
Jul 08 06:55:02.992794 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.992739    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"4139c7d7ec4d56004a93858bd5f1c85f08e45507a5b395136602bc569dd49e19"}
Jul 08 06:55:02.992905 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.992885    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"8c2608fa4a1eec3a380e54eea0cd49f1cdd1e8505cf8b54762d098b368381d42"}
Jul 08 06:55:02.993001 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.992942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"a9f1b9000c9ae7fe73e7215baa401770aa3595fb61e1cd9c925afbb2cdc984a5"}
Jul 08 06:55:02.994163 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.994139    2573 generic.go:356] "Generic (PLEG): container finished" podID="3ad9c2c70c8c6d94cfad6526a2252f5d" containerID="928a9db2c2fc59473a71fcdcdb9aac5ecad9b5d988bff3088b6339b9dbf6a618" exitCode=0
Jul 08 06:55:02.994257 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.994224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" event={"ID":"3ad9c2c70c8c6d94cfad6526a2252f5d","Type":"ContainerDied","Data":"928a9db2c2fc59473a71fcdcdb9aac5ecad9b5d988bff3088b6339b9dbf6a618"}
Jul 08 06:55:02.995688 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.995653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sshz7" event={"ID":"4575f08e-0a3d-4124-962b-43eec74a3a43","Type":"ContainerStarted","Data":"f61e6dffff23a3e8e2d29ff86fa49cc4f8d085a3c1b3d0a367982efa8109d392"}
Jul 08 06:55:02.997225 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.997200    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9qn8n" event={"ID":"7120c08e-40e2-4de6-a9fb-0977b918782d","Type":"ContainerStarted","Data":"c4c0d41d54df0ae74490abbc68a1240a33bb1f2379365a36323f1b15830daa06"}
Jul 08 06:55:02.999973 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:02.999932    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gs6tq" podStartSLOduration=3.407630606 podStartE2EDuration="22.999919092s" totalImagesPullingTime="19.592288486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:02.999440042 +0000 UTC m=+22.694960923" watchObservedRunningTime="2026-07-08 06:55:02.999919092 +0000 UTC m=+22.695440027"
Jul 08 06:55:03.026838 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.026788    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9qn8n" podStartSLOduration=3.2579779110000002 podStartE2EDuration="23.026753497s" totalImagesPullingTime="19.768775586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:03.025586421 +0000 UTC m=+22.721107304" watchObservedRunningTime="2026-07-08 06:55:03.026753497 +0000 UTC m=+22.722274377"
Jul 08 06:55:03.067233 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.067174    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sshz7" podStartSLOduration=3.564263836 podStartE2EDuration="23.067152885s" totalImagesPullingTime="19.502889049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:03.066362638 +0000 UTC m=+22.761883519" watchObservedRunningTime="2026-07-08 06:55:03.067152885 +0000 UTC m=+22.762673765"
Jul 08 06:55:03.105748 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.105696    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-129.ec2.internal" podStartSLOduration=22.105678519 podStartE2EDuration="22.105678519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:03.082399655 +0000 UTC m=+22.777920535" watchObservedRunningTime="2026-07-08 06:55:03.105678519 +0000 UTC m=+22.801199399"
Jul 08 06:55:03.105941 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.105865    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p5k4w" podStartSLOduration=3.58438785 podStartE2EDuration="23.105856061s" totalImagesPullingTime="19.521468211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:03.105398852 +0000 UTC m=+22.800919732" watchObservedRunningTime="2026-07-08 06:55:03.105856061 +0000 UTC m=+22.801376944"
Jul 08 06:55:03.154943 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.154887    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vv587" podStartSLOduration=2.651966356 podStartE2EDuration="22.154870113s" totalImagesPullingTime="19.502903757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:03.133362083 +0000 UTC m=+22.828882965" watchObservedRunningTime="2026-07-08 06:55:03.154870113 +0000 UTC m=+22.850390993"
Jul 08 06:55:03.815569 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.815535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:03.815959 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.815538    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:03.815959 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:03.815675    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:03.815959 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:03.815538    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:03.815959 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:03.815751    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:03.815959 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:03.815817    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:04.003478 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.003412    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" event={"ID":"3ad9c2c70c8c6d94cfad6526a2252f5d","Type":"ContainerStarted","Data":"3ad09434bd57d31b693b2ce40c04b3bdc480ed607b0bc29ab436aa87656c47f7"}
Jul 08 06:55:04.005259 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.005192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t2jjk" event={"ID":"385aa6f4-6a59-41a9-9f86-2e1294f62a3a","Type":"ContainerStarted","Data":"c23505837b29a88ea4caf03a80ffdf630835d26f38413465edf85107d0e09810"}
Jul 08 06:55:04.010977 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.010952    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 06:55:04.021465 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.021421    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-129.ec2.internal" podStartSLOduration=23.021406168 podStartE2EDuration="23.021406168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:04.021094299 +0000 UTC m=+23.716615182" watchObservedRunningTime="2026-07-08 06:55:04.021406168 +0000 UTC m=+23.716927049"
Jul 08 06:55:04.035977 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.035927    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t2jjk" podStartSLOduration=4.442527162 podStartE2EDuration="24.035905639s" totalImagesPullingTime="19.593378477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:04.035647039 +0000 UTC m=+23.731167921" watchObservedRunningTime="2026-07-08 06:55:04.035905639 +0000 UTC m=+23.731426521"
Jul 08 06:55:04.798018 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.797900    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T06:55:04.010971238Z","UUID":"808bba4e-76f5-4a6a-82bf-7a7c3eb992e4","Handler":null,"Name":"","Endpoint":""}
Jul 08 06:55:04.799581 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.799556    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 06:55:04.799703 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:04.799605    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 06:55:05.011625 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:05.011590    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg" event={"ID":"1d381a0a-c35f-467f-a39f-22f29768eeea","Type":"ContainerStarted","Data":"0de01aa73d35e67c4fa325212ee95ea8d206b41c34ec3c40cf9adf89991acc3c"}
Jul 08 06:55:05.815664 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:05.815627    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:05.815874 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:05.815627    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:05.815874 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:05.815755    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:05.815874 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:05.815863    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:05.816028 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:05.815627    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:05.816028 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:05.815977    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:06.016357 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:06.016316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg" event={"ID":"1d381a0a-c35f-467f-a39f-22f29768eeea","Type":"ContainerStarted","Data":"f036b6a0de3afd7c14026f09ee165da2e26e64d62185ab8fa34119a21cc30ddc"}
Jul 08 06:55:06.020352 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:06.020322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"d2faf867321324b4b7da6e13ddc447b1d9e9973681cbcb1679b727f719af4855"}
Jul 08 06:55:07.187896 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:07.187616    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:55:07.188350 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:07.188291    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:55:07.208176 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:07.208124    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rswkg" podStartSLOduration=4.489249186 podStartE2EDuration="26.208107626s" totalImagesPullingTime="21.71885844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:06.039753836 +0000 UTC m=+25.735274719" watchObservedRunningTime="2026-07-08 06:55:07.208107626 +0000 UTC m=+26.903628522"
Jul 08 06:55:07.815129 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:07.815101    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:07.815287 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:07.815140    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:07.815287 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:07.815195    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:07.815287 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:07.815208    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:07.815287 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:07.815260    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:07.815408 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:07.815313    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:08.026022 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:08.025986    2573 generic.go:356] "Generic (PLEG): container finished" podID="1a7f895e-9a70-462d-9003-e36e15b73099" containerID="eaa9185b9f29f9ef173c37d70ebd4a7fb5a1366bd1caa9ed84376724f5b8436d" exitCode=0
Jul 08 06:55:08.026178 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:08.026025    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerDied","Data":"eaa9185b9f29f9ef173c37d70ebd4a7fb5a1366bd1caa9ed84376724f5b8436d"}
Jul 08 06:55:08.029782 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:08.029746    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" event={"ID":"f1cce830-1e29-4969-bc0c-c79eda08cf00","Type":"ContainerStarted","Data":"a7f1c2d669dcf07e9fb9e967e821a0d5c08bfc3a86ff433a9e86ef1f3b2f39aa"}
Jul 08 06:55:08.030076 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:08.030048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:55:08.030506 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:08.030491    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sshz7"
Jul 08 06:55:08.111047 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:08.110939    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn" podStartSLOduration=7.848205181 podStartE2EDuration="28.110922748s" totalImagesPullingTime="20.262717567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:08.110588775 +0000 UTC m=+27.806109657" watchObservedRunningTime="2026-07-08 06:55:08.110922748 +0000 UTC m=+27.806443630"
Jul 08 06:55:09.032092 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.031934    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:55:09.032858 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.032141    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:55:09.032858 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.032187    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:55:09.046048 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.046025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:55:09.046170 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.046127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:55:09.600320 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.600290    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k6qlq"]
Jul 08 06:55:09.600496 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.600435    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:09.600583 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:09.600559    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:09.602367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.602120    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tttrr"]
Jul 08 06:55:09.602367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.602225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:09.602367 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:09.602317    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:09.602856 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.602836    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hqdlr"]
Jul 08 06:55:09.602956 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:09.602931    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:09.603021 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:09.603004    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:10.036101 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:10.036069    2573 generic.go:356] "Generic (PLEG): container finished" podID="1a7f895e-9a70-462d-9003-e36e15b73099" containerID="7283098e9d0b43f3686e2e282fa8bb3b132ca0a1e0fc1a1bb836b3863f906668" exitCode=0
Jul 08 06:55:10.036538 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:10.036154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerDied","Data":"7283098e9d0b43f3686e2e282fa8bb3b132ca0a1e0fc1a1bb836b3863f906668"}
Jul 08 06:55:10.815828 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:10.815793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:10.816003 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:10.815893    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:10.816003 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:10.815939    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:10.816123 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:10.816066    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:11.041072 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:11.041038    2573 generic.go:356] "Generic (PLEG): container finished" podID="1a7f895e-9a70-462d-9003-e36e15b73099" containerID="2b26e814376336afbeed650703cbda6392190a66ce61eddc67e7220ac8936fa7" exitCode=0
Jul 08 06:55:11.041428 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:11.041102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerDied","Data":"2b26e814376336afbeed650703cbda6392190a66ce61eddc67e7220ac8936fa7"}
Jul 08 06:55:11.815651 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:11.815383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:11.815835 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:11.815804    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:12.815836 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:12.815800    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:12.816319 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:12.815844    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:12.816319 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:12.815930    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:12.816319 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:12.816045    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:13.565130 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:13.565095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:13.565323 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:13.565162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:13.565323 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.565256    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:13.565323 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.565268    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:13.565323 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.565309    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret podName:afe5e80d-238d-47b2-8461-4df860065087 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:45.565297271 +0000 UTC m=+65.260818130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret") pod "global-pull-secret-syncer-hqdlr" (UID: "afe5e80d-238d-47b2-8461-4df860065087") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:13.565516 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.565335    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs podName:8b7f7016-2c27-4336-9186-a4d747454693 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:45.565315248 +0000 UTC m=+65.260836126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs") pod "network-metrics-daemon-k6qlq" (UID: "8b7f7016-2c27-4336-9186-a4d747454693") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:13.666375 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:13.666343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:13.666554 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.666532    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:13.666629 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.666562    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:13.666629 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.666577    2573 projected.go:196] Error preparing data for projected volume kube-api-access-srlfx for pod openshift-network-diagnostics/network-check-target-tttrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:13.666743 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.666670    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx podName:9ab05bfd-e233-4096-a9e6-740d0c1eec10 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:45.666651231 +0000 UTC m=+65.362172113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-srlfx" (UniqueName: "kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx") pod "network-check-target-tttrr" (UID: "9ab05bfd-e233-4096-a9e6-740d0c1eec10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:13.815311 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:13.815243    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:13.815479 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:13.815356    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:14.816114 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:14.816067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:14.816576 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:14.816067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:14.816576 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:14.816197    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqdlr" podUID="afe5e80d-238d-47b2-8461-4df860065087"
Jul 08 06:55:14.816576 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:14.816276    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6qlq" podUID="8b7f7016-2c27-4336-9186-a4d747454693"
Jul 08 06:55:15.816025 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:15.815977    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:15.816209 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:15.816098    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tttrr" podUID="9ab05bfd-e233-4096-a9e6-740d0c1eec10"
Jul 08 06:55:16.056004 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.055970    2573 generic.go:356] "Generic (PLEG): container finished" podID="1a7f895e-9a70-462d-9003-e36e15b73099" containerID="bf4f55d3fd41970b65f265e4ac7588c7a14d091df38c5d778652dcfb20ad5788" exitCode=0
Jul 08 06:55:16.056004 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.056005    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerDied","Data":"bf4f55d3fd41970b65f265e4ac7588c7a14d091df38c5d778652dcfb20ad5788"}
Jul 08 06:55:16.141194 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.141157    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-129.ec2.internal" event="NodeReady"
Jul 08 06:55:16.141338 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.141325    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 06:55:16.194524 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.194491    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mxd2j"]
Jul 08 06:55:16.197199 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.197178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.199404 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.199380    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xkml7"]
Jul 08 06:55:16.199630 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.199612    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 06:55:16.199713 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.199699    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 06:55:16.200367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.200348    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6zr5\""
Jul 08 06:55:16.202074 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.202059    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.204232 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.204211    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 06:55:16.204327 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.204266    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 06:55:16.204327 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.204287    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 06:55:16.204414 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.204290    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fs5kh\""
Jul 08 06:55:16.214594 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.212252    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxd2j"]
Jul 08 06:55:16.216350 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.216327    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkml7"]
Jul 08 06:55:16.287433 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.287392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a90417f-8479-4d53-aef4-55c0eb6ff45a-config-volume\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.287433 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.287434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a90417f-8479-4d53-aef4-55c0eb6ff45a-tmp-dir\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.287625 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.287523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.287625 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.287551    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2vd\" (UniqueName: \"kubernetes.io/projected/1a90417f-8479-4d53-aef4-55c0eb6ff45a-kube-api-access-8v2vd\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.287625 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.287610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69bc16c5-ea89-455b-8f34-02cb389ece14-cert\") pod \"ingress-canary-xkml7\" (UID: \"69bc16c5-ea89-455b-8f34-02cb389ece14\") " pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.287718 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.287636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jlg\" (UniqueName: \"kubernetes.io/projected/69bc16c5-ea89-455b-8f34-02cb389ece14-kube-api-access-m5jlg\") pod \"ingress-canary-xkml7\" (UID: \"69bc16c5-ea89-455b-8f34-02cb389ece14\") " pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.388228 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jlg\" (UniqueName: \"kubernetes.io/projected/69bc16c5-ea89-455b-8f34-02cb389ece14-kube-api-access-m5jlg\") pod \"ingress-canary-xkml7\" (UID: \"69bc16c5-ea89-455b-8f34-02cb389ece14\") " pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.388228 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a90417f-8479-4d53-aef4-55c0eb6ff45a-config-volume\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.388228 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a90417f-8479-4d53-aef4-55c0eb6ff45a-tmp-dir\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.388491 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.388491 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2vd\" (UniqueName: \"kubernetes.io/projected/1a90417f-8479-4d53-aef4-55c0eb6ff45a-kube-api-access-8v2vd\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.388491 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:16.388480    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 06:55:16.388628 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69bc16c5-ea89-455b-8f34-02cb389ece14-cert\") pod \"ingress-canary-xkml7\" (UID: \"69bc16c5-ea89-455b-8f34-02cb389ece14\") " pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.388628 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388522    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a90417f-8479-4d53-aef4-55c0eb6ff45a-tmp-dir\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.388628 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:16.388546    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls podName:1a90417f-8479-4d53-aef4-55c0eb6ff45a nodeName:}" failed. No retries permitted until 2026-07-08 06:55:16.888526541 +0000 UTC m=+36.584047412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls") pod "dns-default-mxd2j" (UID: "1a90417f-8479-4d53-aef4-55c0eb6ff45a") : secret "dns-default-metrics-tls" not found
Jul 08 06:55:16.388802 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.388718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a90417f-8479-4d53-aef4-55c0eb6ff45a-config-volume\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.392655 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.392631    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69bc16c5-ea89-455b-8f34-02cb389ece14-cert\") pod \"ingress-canary-xkml7\" (UID: \"69bc16c5-ea89-455b-8f34-02cb389ece14\") " pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.397189 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.397167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jlg\" (UniqueName: \"kubernetes.io/projected/69bc16c5-ea89-455b-8f34-02cb389ece14-kube-api-access-m5jlg\") pod \"ingress-canary-xkml7\" (UID: \"69bc16c5-ea89-455b-8f34-02cb389ece14\") " pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.397285 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.397272    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2vd\" (UniqueName: \"kubernetes.io/projected/1a90417f-8479-4d53-aef4-55c0eb6ff45a-kube-api-access-8v2vd\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.528680 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.528630    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkml7"
Jul 08 06:55:16.669346 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.669086    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkml7"]
Jul 08 06:55:16.672335 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:16.672310    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bc16c5_ea89_455b_8f34_02cb389ece14.slice/crio-a30f066c7529a3513f659fee9ea8d4f7a4e78301d633a929f9ea1d6d5aeaf2d9 WatchSource:0}: Error finding container a30f066c7529a3513f659fee9ea8d4f7a4e78301d633a929f9ea1d6d5aeaf2d9: Status 404 returned error can't find the container with id a30f066c7529a3513f659fee9ea8d4f7a4e78301d633a929f9ea1d6d5aeaf2d9
Jul 08 06:55:16.815384 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.815342    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:16.815548 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.815529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:16.818517 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.818494    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4f688\""
Jul 08 06:55:16.818517 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.818507    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 06:55:16.819092 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.818579    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 06:55:16.893180 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:16.893152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:16.893393 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:16.893270    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 06:55:16.893393 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:16.893322    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls podName:1a90417f-8479-4d53-aef4-55c0eb6ff45a nodeName:}" failed. No retries permitted until 2026-07-08 06:55:17.893310415 +0000 UTC m=+37.588831273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls") pod "dns-default-mxd2j" (UID: "1a90417f-8479-4d53-aef4-55c0eb6ff45a") : secret "dns-default-metrics-tls" not found
Jul 08 06:55:17.059571 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.059536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkml7" event={"ID":"69bc16c5-ea89-455b-8f34-02cb389ece14","Type":"ContainerStarted","Data":"a30f066c7529a3513f659fee9ea8d4f7a4e78301d633a929f9ea1d6d5aeaf2d9"}
Jul 08 06:55:17.063165 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.063137    2573 generic.go:356] "Generic (PLEG): container finished" podID="1a7f895e-9a70-462d-9003-e36e15b73099" containerID="f1968a804cb3560041b52feb07f31d84d16c9bd496144f2559069fe43d9ea695" exitCode=0
Jul 08 06:55:17.063292 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.063178    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerDied","Data":"f1968a804cb3560041b52feb07f31d84d16c9bd496144f2559069fe43d9ea695"}
Jul 08 06:55:17.815601 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.815562    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:17.818602 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.818576    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 06:55:17.819154 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.819136    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6n2tj\""
Jul 08 06:55:17.819256 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.819136    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 06:55:17.902124 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:17.902083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:17.902288 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:17.902274    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 06:55:17.902368 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:17.902354    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls podName:1a90417f-8479-4d53-aef4-55c0eb6ff45a nodeName:}" failed. No retries permitted until 2026-07-08 06:55:19.902332358 +0000 UTC m=+39.597853220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls") pod "dns-default-mxd2j" (UID: "1a90417f-8479-4d53-aef4-55c0eb6ff45a") : secret "dns-default-metrics-tls" not found
Jul 08 06:55:18.069812 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:18.069719    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" event={"ID":"1a7f895e-9a70-462d-9003-e36e15b73099","Type":"ContainerStarted","Data":"089944e347b76433d024e95bb301f281ff123f20453cb7b70248421b57ac5f07"}
Jul 08 06:55:18.095671 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:18.095578    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s2j4q" podStartSLOduration=8.497224069 podStartE2EDuration="38.095560446s" totalImagesPullingTime="29.598336377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:18.095348649 +0000 UTC m=+37.790869531" watchObservedRunningTime="2026-07-08 06:55:18.095560446 +0000 UTC m=+37.791081305"
Jul 08 06:55:19.073665 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:19.073472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkml7" event={"ID":"69bc16c5-ea89-455b-8f34-02cb389ece14","Type":"ContainerStarted","Data":"5f8c9ef86a6eb534ce266a1ef07ba8c455eb34a37a447b5518012ce80faa00d3"}
Jul 08 06:55:19.090336 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:19.090287    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xkml7" podStartSLOduration=1.055721977 podStartE2EDuration="3.090270284s" totalImagesPullingTime="2.034548307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:19.088918564 +0000 UTC m=+38.784439444" watchObservedRunningTime="2026-07-08 06:55:19.090270284 +0000 UTC m=+38.785791142"
Jul 08 06:55:19.917383 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:19.917341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:19.917591 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:19.917510    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 06:55:19.917591 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:19.917583    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls podName:1a90417f-8479-4d53-aef4-55c0eb6ff45a nodeName:}" failed. No retries permitted until 2026-07-08 06:55:23.917563713 +0000 UTC m=+43.613084573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls") pod "dns-default-mxd2j" (UID: "1a90417f-8479-4d53-aef4-55c0eb6ff45a") : secret "dns-default-metrics-tls" not found
Jul 08 06:55:20.584484 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.584448    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"]
Jul 08 06:55:20.607124 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.607096    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.607550 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.607435    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"]
Jul 08 06:55:20.610112 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.610086    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 08 06:55:20.610239 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.610173    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 08 06:55:20.610951 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.610920    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vxjgh\""
Jul 08 06:55:20.611068 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.610972    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 08 06:55:20.611068 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.610992    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:55:20.617365 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.617344    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"]
Jul 08 06:55:20.633316 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.633291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"
Jul 08 06:55:20.633515 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.633493    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"]
Jul 08 06:55:20.636230 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.636209    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-b7r8m\""
Jul 08 06:55:20.721974 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.721940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98968\" (UniqueName: \"kubernetes.io/projected/c81e906e-429a-4ee9-b182-4fcf5b896b17-kube-api-access-98968\") pod \"network-check-source-989f8b8dc-fjzgc\" (UID: \"c81e906e-429a-4ee9-b182-4fcf5b896b17\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"
Jul 08 06:55:20.722133 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.721988    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b230a624-c0e3-4929-b785-7186cb82f537-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.722133 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.722035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xs2c\" (UniqueName: \"kubernetes.io/projected/b230a624-c0e3-4929-b785-7186cb82f537-kube-api-access-4xs2c\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.722133 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.722093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b230a624-c0e3-4929-b785-7186cb82f537-config\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.791982 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.791949    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"]
Jul 08 06:55:20.815347 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.815321    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86f844d7bc-p2zxg"]
Jul 08 06:55:20.815496 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.815447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:20.818655 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.818632    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 08 06:55:20.818793 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.818670    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:55:20.818793 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.818639    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 08 06:55:20.818793 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.818714    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2s8td\""
Jul 08 06:55:20.822412 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.822388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b230a624-c0e3-4929-b785-7186cb82f537-config\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.822507 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.822460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98968\" (UniqueName: \"kubernetes.io/projected/c81e906e-429a-4ee9-b182-4fcf5b896b17-kube-api-access-98968\") pod \"network-check-source-989f8b8dc-fjzgc\" (UID: \"c81e906e-429a-4ee9-b182-4fcf5b896b17\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"
Jul 08 06:55:20.822561 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.822507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b230a624-c0e3-4929-b785-7186cb82f537-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.822561 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.822530    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xs2c\" (UniqueName: \"kubernetes.io/projected/b230a624-c0e3-4929-b785-7186cb82f537-kube-api-access-4xs2c\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.823079 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.823060    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b230a624-c0e3-4929-b785-7186cb82f537-config\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.826989 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.826968    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b230a624-c0e3-4929-b785-7186cb82f537-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.832312 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.832288    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98968\" (UniqueName: \"kubernetes.io/projected/c81e906e-429a-4ee9-b182-4fcf5b896b17-kube-api-access-98968\") pod \"network-check-source-989f8b8dc-fjzgc\" (UID: \"c81e906e-429a-4ee9-b182-4fcf5b896b17\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"
Jul 08 06:55:20.832929 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.832807    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xs2c\" (UniqueName: \"kubernetes.io/projected/b230a624-c0e3-4929-b785-7186cb82f537-kube-api-access-4xs2c\") pod \"service-ca-operator-5d46d9ffd4-xps6f\" (UID: \"b230a624-c0e3-4929-b785-7186cb82f537\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.840038 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.839988    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"]
Jul 08 06:55:20.840177 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.840161    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:20.843272 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.843253    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 08 06:55:20.846084 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.844161    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 06:55:20.846084 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.844267    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86f844d7bc-p2zxg"]
Jul 08 06:55:20.846084 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.844726    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 08 06:55:20.846084 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.845459    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 08 06:55:20.846084 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.845646    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 06:55:20.846369 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.846143    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 08 06:55:20.846369 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.846352    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m85db\""
Jul 08 06:55:20.916734 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.916697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"
Jul 08 06:55:20.923046 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.923015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fnlc\" (UniqueName: \"kubernetes.io/projected/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-kube-api-access-6fnlc\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:20.923125 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.923059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-default-certificate\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:20.923125 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.923085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb5ph\" (UniqueName: \"kubernetes.io/projected/4d20e8ee-3269-4aad-ac44-e297ea819934-kube-api-access-kb5ph\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:20.923189 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.923127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:20.923189 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.923150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-stats-auth\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:20.923189 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.923173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:20.923280 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.923216    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:20.942173 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:20.942147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"
Jul 08 06:55:21.023731 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.023607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:21.023731 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.023708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fnlc\" (UniqueName: \"kubernetes.io/projected/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-kube-api-access-6fnlc\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:21.023979 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.023744    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 06:55:21.023979 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.023751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-default-certificate\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.023979 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.023794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb5ph\" (UniqueName: \"kubernetes.io/projected/4d20e8ee-3269-4aad-ac44-e297ea819934-kube-api-access-kb5ph\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.023979 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.023840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.023979 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.023862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-stats-auth\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.023979 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.023879    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls podName:b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec nodeName:}" failed. No retries permitted until 2026-07-08 06:55:21.523858814 +0000 UTC m=+41.219379696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l2hw2" (UID: "b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec") : secret "samples-operator-tls" not found
Jul 08 06:55:21.023979 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.023917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.024345 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.024028    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 06:55:21.024345 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.024069    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:21.524055398 +0000 UTC m=+41.219576257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : secret "router-metrics-certs-default" not found
Jul 08 06:55:21.024954 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.024918    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:21.524895412 +0000 UTC m=+41.220416293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : configmap references non-existent config key: service-ca.crt
Jul 08 06:55:21.027326 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.027294    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-default-certificate\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.028556 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.028529    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-stats-auth\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.034367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.033951    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fnlc\" (UniqueName: \"kubernetes.io/projected/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-kube-api-access-6fnlc\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:21.034686 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.034637    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb5ph\" (UniqueName: \"kubernetes.io/projected/4d20e8ee-3269-4aad-ac44-e297ea819934-kube-api-access-kb5ph\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.083602 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.083569    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f"]
Jul 08 06:55:21.087313 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:21.087288    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb230a624_c0e3_4929_b785_7186cb82f537.slice/crio-78f1a3ed18a6e9eb73e0044ebefa21d06f62b8fc76d6a07c392fb99cf355dce4 WatchSource:0}: Error finding container 78f1a3ed18a6e9eb73e0044ebefa21d06f62b8fc76d6a07c392fb99cf355dce4: Status 404 returned error can't find the container with id 78f1a3ed18a6e9eb73e0044ebefa21d06f62b8fc76d6a07c392fb99cf355dce4
Jul 08 06:55:21.106420 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.106394    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc"]
Jul 08 06:55:21.110429 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:21.110407    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81e906e_429a_4ee9_b182_4fcf5b896b17.slice/crio-fbf38cccb2fda90d503de9ed26eac63c80cbacaedac8815fc6cdd0eda11e49d6 WatchSource:0}: Error finding container fbf38cccb2fda90d503de9ed26eac63c80cbacaedac8815fc6cdd0eda11e49d6: Status 404 returned error can't find the container with id fbf38cccb2fda90d503de9ed26eac63c80cbacaedac8815fc6cdd0eda11e49d6
Jul 08 06:55:21.527437 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.527396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.527642 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.527446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:21.527642 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:21.527494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:21.527642 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.527574    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:22.527551587 +0000 UTC m=+42.223072463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : configmap references non-existent config key: service-ca.crt
Jul 08 06:55:21.527642 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.527616    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 06:55:21.527642 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.527626    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 06:55:21.527880 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.527663    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:22.527652077 +0000 UTC m=+42.223172936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : secret "router-metrics-certs-default" not found
Jul 08 06:55:21.527880 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:21.527678    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls podName:b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec nodeName:}" failed. No retries permitted until 2026-07-08 06:55:22.527672142 +0000 UTC m=+42.223193001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l2hw2" (UID: "b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec") : secret "samples-operator-tls" not found
Jul 08 06:55:22.082146 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:22.082104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc" event={"ID":"c81e906e-429a-4ee9-b182-4fcf5b896b17","Type":"ContainerStarted","Data":"fbf38cccb2fda90d503de9ed26eac63c80cbacaedac8815fc6cdd0eda11e49d6"}
Jul 08 06:55:22.083605 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:22.083545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f" event={"ID":"b230a624-c0e3-4929-b785-7186cb82f537","Type":"ContainerStarted","Data":"78f1a3ed18a6e9eb73e0044ebefa21d06f62b8fc76d6a07c392fb99cf355dce4"}
Jul 08 06:55:22.537307 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:22.537267    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:22.537508 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:22.537342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:22.537508 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:22.537438    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 06:55:22.537508 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:22.537454    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 06:55:22.537650 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:22.537512    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls podName:b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec nodeName:}" failed. No retries permitted until 2026-07-08 06:55:24.537494072 +0000 UTC m=+44.233014935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l2hw2" (UID: "b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec") : secret "samples-operator-tls" not found
Jul 08 06:55:22.537650 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:22.537557    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:24.537531024 +0000 UTC m=+44.233051886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : secret "router-metrics-certs-default" not found
Jul 08 06:55:22.537793 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:22.537651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:22.537793 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:22.537777    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:24.537750178 +0000 UTC m=+44.233271055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : configmap references non-existent config key: service-ca.crt
Jul 08 06:55:23.948841 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:23.948803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:23.949280 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:23.948975    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 06:55:23.949280 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:23.949038    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls podName:1a90417f-8479-4d53-aef4-55c0eb6ff45a nodeName:}" failed. No retries permitted until 2026-07-08 06:55:31.949023187 +0000 UTC m=+51.644544045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls") pod "dns-default-mxd2j" (UID: "1a90417f-8479-4d53-aef4-55c0eb6ff45a") : secret "dns-default-metrics-tls" not found
Jul 08 06:55:24.549305 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.549242    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"]
Jul 08 06:55:24.553216 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.553174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:24.553368 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.553226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:24.553368 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.553272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:24.553478 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.553361    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:28.553337058 +0000 UTC m=+48.248857954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : configmap references non-existent config key: service-ca.crt
Jul 08 06:55:24.553478 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.553390    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 06:55:24.553478 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.553410    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 06:55:24.553478 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.553443    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls podName:b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec nodeName:}" failed. No retries permitted until 2026-07-08 06:55:28.553426747 +0000 UTC m=+48.248947609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l2hw2" (UID: "b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec") : secret "samples-operator-tls" not found
Jul 08 06:55:24.553478 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.553463    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:28.553449781 +0000 UTC m=+48.248970643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : secret "router-metrics-certs-default" not found
Jul 08 06:55:24.572241 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.572182    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"]
Jul 08 06:55:24.572458 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.572313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"
Jul 08 06:55:24.574661 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.574638    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nbq7c\""
Jul 08 06:55:24.574819 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.574672    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 06:55:24.576022 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.575999    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 06:55:24.716352 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.716313    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jhdpb"]
Jul 08 06:55:24.728783 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.728741    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.732362 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.732341    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 06:55:24.732494 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.732392    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 06:55:24.733045 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.733022    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 06:55:24.733132 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.733031    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 06:55:24.734689 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.734568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h6mll\""
Jul 08 06:55:24.753418 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.753394    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhdpb"]
Jul 08 06:55:24.754544 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.754528    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpx5\" (UniqueName: \"kubernetes.io/projected/8370199a-c475-488d-9044-106856cd7611-kube-api-access-xdpx5\") pod \"migrator-d57d58cc9-445s9\" (UID: \"8370199a-c475-488d-9044-106856cd7611\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"
Jul 08 06:55:24.855141 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.855053    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpx5\" (UniqueName: \"kubernetes.io/projected/8370199a-c475-488d-9044-106856cd7611-kube-api-access-xdpx5\") pod \"migrator-d57d58cc9-445s9\" (UID: \"8370199a-c475-488d-9044-106856cd7611\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"
Jul 08 06:55:24.855141 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.855096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a45bcf29-6e71-4280-9525-84fac4d59374-data-volume\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.855141 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.855122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ds5m\" (UniqueName: \"kubernetes.io/projected/a45bcf29-6e71-4280-9525-84fac4d59374-kube-api-access-4ds5m\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.855435 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.855147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a45bcf29-6e71-4280-9525-84fac4d59374-crio-socket\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.855435 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.855170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.855435 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.855197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.865544 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.865515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpx5\" (UniqueName: \"kubernetes.io/projected/8370199a-c475-488d-9044-106856cd7611-kube-api-access-xdpx5\") pod \"migrator-d57d58cc9-445s9\" (UID: \"8370199a-c475-488d-9044-106856cd7611\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"
Jul 08 06:55:24.883498 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.883470    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"
Jul 08 06:55:24.956095 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.956050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a45bcf29-6e71-4280-9525-84fac4d59374-data-volume\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.956095 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.956094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ds5m\" (UniqueName: \"kubernetes.io/projected/a45bcf29-6e71-4280-9525-84fac4d59374-kube-api-access-4ds5m\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.956115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a45bcf29-6e71-4280-9525-84fac4d59374-crio-socket\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.956131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.956158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.956236    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.956308    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.956311    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:25.456288215 +0000 UTC m=+45.151809092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : configmap "kube-rbac-proxy" not found
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:24.956356    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:25.456345801 +0000 UTC m=+45.151866660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.956350    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a45bcf29-6e71-4280-9525-84fac4d59374-crio-socket\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.956562 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.956434    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a45bcf29-6e71-4280-9525-84fac4d59374-data-volume\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:24.965362 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:24.965338    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ds5m\" (UniqueName: \"kubernetes.io/projected/a45bcf29-6e71-4280-9525-84fac4d59374-kube-api-access-4ds5m\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:25.238546 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:25.238520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9"]
Jul 08 06:55:25.241499 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:25.241473    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8370199a_c475_488d_9044_106856cd7611.slice/crio-7b54eefe08ad46ad21f74089774c35949f93448b6762b2f303a8ee34f9a035ae WatchSource:0}: Error finding container 7b54eefe08ad46ad21f74089774c35949f93448b6762b2f303a8ee34f9a035ae: Status 404 returned error can't find the container with id 7b54eefe08ad46ad21f74089774c35949f93448b6762b2f303a8ee34f9a035ae
Jul 08 06:55:25.462019 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:25.461919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:25.462019 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:25.461980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:25.462229 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:25.462066    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 06:55:25.462229 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:25.462154    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:26.462132055 +0000 UTC m=+46.157652917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : configmap "kube-rbac-proxy" not found
Jul 08 06:55:25.462229 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:25.462172    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:25.462358 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:25.462238    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:26.462220149 +0000 UTC m=+46.157741010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:26.095261 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:26.095219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9" event={"ID":"8370199a-c475-488d-9044-106856cd7611","Type":"ContainerStarted","Data":"7b54eefe08ad46ad21f74089774c35949f93448b6762b2f303a8ee34f9a035ae"}
Jul 08 06:55:26.097495 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:26.097019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc" event={"ID":"c81e906e-429a-4ee9-b182-4fcf5b896b17","Type":"ContainerStarted","Data":"55d258d5eb0ac85aeb8020ca7e140b32aff2fa7cd9b0add801ebb5b02bf88530"}
Jul 08 06:55:26.098616 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:26.098580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f" event={"ID":"b230a624-c0e3-4929-b785-7186cb82f537","Type":"ContainerStarted","Data":"1a5f9839487076f2f31caf33bd8d328bc3237a104c1613836895e9b58c5692cf"}
Jul 08 06:55:26.116549 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:26.116495    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fjzgc" podStartSLOduration=2.107234052 podStartE2EDuration="6.11647765s" totalImagesPullingTime="4.009243598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:26.114745654 +0000 UTC m=+45.810266536" watchObservedRunningTime="2026-07-08 06:55:26.11647765 +0000 UTC m=+45.811998532"
Jul 08 06:55:26.131477 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:26.131426    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f" podStartSLOduration=2.106876892 podStartE2EDuration="6.13141078s" totalImagesPullingTime="4.024533888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:26.130215442 +0000 UTC m=+45.825736336" watchObservedRunningTime="2026-07-08 06:55:26.13141078 +0000 UTC m=+45.826931663"
Jul 08 06:55:26.471716 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:26.471645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:26.471716 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:26.471682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:26.471920 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:26.471787    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 06:55:26.471920 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:26.471862    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:26.471920 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:26.471876    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:28.471854692 +0000 UTC m=+48.167375554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : configmap "kube-rbac-proxy" not found
Jul 08 06:55:26.471920 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:26.471904    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:28.471893943 +0000 UTC m=+48.167414801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:27.103153 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:27.103062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9" event={"ID":"8370199a-c475-488d-9044-106856cd7611","Type":"ContainerStarted","Data":"bc01037cf0ad44f1407883aa76db662ac335a0e535a1f3c86c942ccd394dcd9c"}
Jul 08 06:55:27.103153 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:27.103126    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9" event={"ID":"8370199a-c475-488d-9044-106856cd7611","Type":"ContainerStarted","Data":"03068f30c91b84b850702948799df5fdeb06146333cd18a4f09ab5092f1f28ee"}
Jul 08 06:55:27.122443 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:27.122394    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-445s9" podStartSLOduration=1.649379368 podStartE2EDuration="3.122377848s" totalImagesPullingTime="1.47299848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:27.121890012 +0000 UTC m=+46.817410894" watchObservedRunningTime="2026-07-08 06:55:27.122377848 +0000 UTC m=+46.817898778"
Jul 08 06:55:27.637317 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:27.637292    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vv587_0389afe8-f7d2-4543-93fd-03bbf7b422a5/dns-node-resolver/0.log"
Jul 08 06:55:28.437430 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:28.437402    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gs6tq_ba6d7dae-f54d-49da-a43e-7623d1e7ce64/node-ca/0.log"
Jul 08 06:55:28.488339 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:28.488301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:28.488339 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:28.488339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:28.488556 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.488422    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 06:55:28.488556 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.488475    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:28.488556 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.488487    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:32.488471692 +0000 UTC m=+52.183992557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : configmap "kube-rbac-proxy" not found
Jul 08 06:55:28.488556 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.488515    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:32.488504045 +0000 UTC m=+52.184024905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:28.588979 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:28.588943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:28.589176 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:28.589076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:28.589176 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.589094    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 06:55:28.589176 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:28.589108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:28.589176 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.589157    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls podName:b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec nodeName:}" failed. No retries permitted until 2026-07-08 06:55:36.58913851 +0000 UTC m=+56.284659369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l2hw2" (UID: "b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec") : secret "samples-operator-tls" not found
Jul 08 06:55:28.589360 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.589252    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:36.589237641 +0000 UTC m=+56.284758505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : configmap references non-existent config key: service-ca.crt
Jul 08 06:55:28.589360 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.589287    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 06:55:28.589360 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:28.589338    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:36.589323785 +0000 UTC m=+56.284844649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : secret "router-metrics-certs-default" not found
Jul 08 06:55:29.438217 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:29.438186    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xkml7_69bc16c5-ea89-455b-8f34-02cb389ece14/serve-healthcheck-canary/0.log"
Jul 08 06:55:29.643832 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:29.643803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-445s9_8370199a-c475-488d-9044-106856cd7611/migrator/0.log"
Jul 08 06:55:29.838017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:29.837988    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-445s9_8370199a-c475-488d-9044-106856cd7611/graceful-termination/0.log"
Jul 08 06:55:32.020579 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:32.020540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:32.020995 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:32.020697    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 06:55:32.020995 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:32.020758    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls podName:1a90417f-8479-4d53-aef4-55c0eb6ff45a nodeName:}" failed. No retries permitted until 2026-07-08 06:55:48.020742231 +0000 UTC m=+67.716263089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls") pod "dns-default-mxd2j" (UID: "1a90417f-8479-4d53-aef4-55c0eb6ff45a") : secret "dns-default-metrics-tls" not found
Jul 08 06:55:32.524486 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:32.524448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:32.524486 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:32.524487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:32.524788 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:32.524573    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 06:55:32.524788 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:32.524591    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:32.524788 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:32.524638    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:40.524623188 +0000 UTC m=+60.220144048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : configmap "kube-rbac-proxy" not found
Jul 08 06:55:32.524788 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:32.524652    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:40.524646024 +0000 UTC m=+60.220166882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:36.656716 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:36.656678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:36.656716 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:36.656719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:36.657306 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:36.656836    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 06:55:36.657306 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:36.656854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:36.657306 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:36.656860    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:52.656843561 +0000 UTC m=+72.352364420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : configmap references non-existent config key: service-ca.crt
Jul 08 06:55:36.657306 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:36.656894    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs podName:4d20e8ee-3269-4aad-ac44-e297ea819934 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:52.656880654 +0000 UTC m=+72.352401513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs") pod "router-default-86f844d7bc-p2zxg" (UID: "4d20e8ee-3269-4aad-ac44-e297ea819934") : secret "router-metrics-certs-default" not found
Jul 08 06:55:36.659087 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:36.659071    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l2hw2\" (UID: \"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:36.725491 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:36.725456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"
Jul 08 06:55:36.853505 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:36.853470    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2"]
Jul 08 06:55:37.130478 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:37.130444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2" event={"ID":"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec","Type":"ContainerStarted","Data":"e33df4aa984b7aad1b5602728b4fed9edebaa19675d19df5485e6d5e0f3eabcd"}
Jul 08 06:55:39.141308 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:39.141278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2" event={"ID":"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec","Type":"ContainerStarted","Data":"c1d3dc30551cf9f655845629f028e8e42892ac7ee9fa808ebfbb8b2192235014"}
Jul 08 06:55:40.146758 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:40.146722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2" event={"ID":"b7d1fd8a-39ff-4028-a9d5-cf95b4d883ec","Type":"ContainerStarted","Data":"837ba4faea4fbfc816a01948773fe12234b15475d4092fa3f05aade3946b404b"}
Jul 08 06:55:40.163937 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:40.163886    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l2hw2" podStartSLOduration=18.031577971 podStartE2EDuration="20.163871401s" totalImagesPullingTime="2.13229343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:40.162675212 +0000 UTC m=+59.858196094" watchObservedRunningTime="2026-07-08 06:55:40.163871401 +0000 UTC m=+59.859392282"
Jul 08 06:55:40.590893 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:40.590850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:40.590893 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:40.590894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:40.591102 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:40.590988    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:40.591102 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:55:40.591038    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls podName:a45bcf29-6e71-4280-9525-84fac4d59374 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:56.591025563 +0000 UTC m=+76.286546422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhdpb" (UID: "a45bcf29-6e71-4280-9525-84fac4d59374") : secret "insights-runtime-extractor-tls" not found
Jul 08 06:55:40.591388 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:40.591366    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a45bcf29-6e71-4280-9525-84fac4d59374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:41.058806 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:41.058777    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vftkn"
Jul 08 06:55:45.632176 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.632136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:45.632590 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.632208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:45.634727 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.634709    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 06:55:45.634819 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.634753    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 06:55:45.645617 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.645596    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afe5e80d-238d-47b2-8461-4df860065087-original-pull-secret\") pod \"global-pull-secret-syncer-hqdlr\" (UID: \"afe5e80d-238d-47b2-8461-4df860065087\") " pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:45.645730 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.645705    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7f7016-2c27-4336-9186-a4d747454693-metrics-certs\") pod \"network-metrics-daemon-k6qlq\" (UID: \"8b7f7016-2c27-4336-9186-a4d747454693\") " pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:45.733380 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.733319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:45.735825 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.735803    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srlfx\" (UniqueName: \"kubernetes.io/projected/9ab05bfd-e233-4096-a9e6-740d0c1eec10-kube-api-access-srlfx\") pod \"network-check-target-tttrr\" (UID: \"9ab05bfd-e233-4096-a9e6-740d0c1eec10\") " pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:45.926286 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.926194    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqdlr"
Jul 08 06:55:45.933466 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.933439    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4f688\""
Jul 08 06:55:45.941854 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:45.941823    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6qlq"
Jul 08 06:55:46.028654 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:46.028627    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6n2tj\""
Jul 08 06:55:46.036187 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:46.036157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:46.062939 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:46.062890    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hqdlr"]
Jul 08 06:55:46.067160 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:46.067129    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe5e80d_238d_47b2_8461_4df860065087.slice/crio-b11d8b0b5740a2bc15db825cdc64277f6f9850abacf4d82f0d926344d72e09f9 WatchSource:0}: Error finding container b11d8b0b5740a2bc15db825cdc64277f6f9850abacf4d82f0d926344d72e09f9: Status 404 returned error can't find the container with id b11d8b0b5740a2bc15db825cdc64277f6f9850abacf4d82f0d926344d72e09f9
Jul 08 06:55:46.088488 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:46.088453    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k6qlq"]
Jul 08 06:55:46.094275 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:46.094231    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7f7016_2c27_4336_9186_a4d747454693.slice/crio-1c841287ac2659c22850961ed04aa88550cad859b94c85944ebc7ed5594a8d6a WatchSource:0}: Error finding container 1c841287ac2659c22850961ed04aa88550cad859b94c85944ebc7ed5594a8d6a: Status 404 returned error can't find the container with id 1c841287ac2659c22850961ed04aa88550cad859b94c85944ebc7ed5594a8d6a
Jul 08 06:55:46.164999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:46.164968    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6qlq" event={"ID":"8b7f7016-2c27-4336-9186-a4d747454693","Type":"ContainerStarted","Data":"1c841287ac2659c22850961ed04aa88550cad859b94c85944ebc7ed5594a8d6a"}
Jul 08 06:55:46.166025 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:46.165995    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hqdlr" event={"ID":"afe5e80d-238d-47b2-8461-4df860065087","Type":"ContainerStarted","Data":"b11d8b0b5740a2bc15db825cdc64277f6f9850abacf4d82f0d926344d72e09f9"}
Jul 08 06:55:46.167626 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:46.167603    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tttrr"]
Jul 08 06:55:46.170623 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:46.170601    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab05bfd_e233_4096_a9e6_740d0c1eec10.slice/crio-47117f9106883eb3a8fde3c723ba1e429c61cef6c1479d0702e45ebb41fc750b WatchSource:0}: Error finding container 47117f9106883eb3a8fde3c723ba1e429c61cef6c1479d0702e45ebb41fc750b: Status 404 returned error can't find the container with id 47117f9106883eb3a8fde3c723ba1e429c61cef6c1479d0702e45ebb41fc750b
Jul 08 06:55:47.171741 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:47.171703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tttrr" event={"ID":"9ab05bfd-e233-4096-a9e6-740d0c1eec10","Type":"ContainerStarted","Data":"cd84975d18f9d724f34a444b721929849702c79654721ff67a53de44f1bfd545"}
Jul 08 06:55:47.172154 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:47.171786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tttrr" event={"ID":"9ab05bfd-e233-4096-a9e6-740d0c1eec10","Type":"ContainerStarted","Data":"47117f9106883eb3a8fde3c723ba1e429c61cef6c1479d0702e45ebb41fc750b"}
Jul 08 06:55:47.172154 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:47.171874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:55:47.189968 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:47.189909    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tttrr" podStartSLOduration=66.189890186 podStartE2EDuration="1m6.189890186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:47.188908214 +0000 UTC m=+66.884429088" watchObservedRunningTime="2026-07-08 06:55:47.189890186 +0000 UTC m=+66.885411067"
Jul 08 06:55:48.051995 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.051960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:48.054561 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.054531    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a90417f-8479-4d53-aef4-55c0eb6ff45a-metrics-tls\") pod \"dns-default-mxd2j\" (UID: \"1a90417f-8479-4d53-aef4-55c0eb6ff45a\") " pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:48.177596 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.177561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6qlq" event={"ID":"8b7f7016-2c27-4336-9186-a4d747454693","Type":"ContainerStarted","Data":"a6a3e1527c9158974279d08b13550245a7df5d92b35b60bea94e531e38b8fd14"}
Jul 08 06:55:48.178073 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.177622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6qlq" event={"ID":"8b7f7016-2c27-4336-9186-a4d747454693","Type":"ContainerStarted","Data":"1e3e2e79e7ba2f291604be285cf5a6d1f54bd5337c85df2fe3c67e0113480324"}
Jul 08 06:55:48.194708 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.194649    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k6qlq" podStartSLOduration=66.18463141 podStartE2EDuration="1m7.194626571s" totalImagesPullingTime="1.009995161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:48.193908695 +0000 UTC m=+67.889429579" watchObservedRunningTime="2026-07-08 06:55:48.194626571 +0000 UTC m=+67.890147454"
Jul 08 06:55:48.326533 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.326453    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6zr5\""
Jul 08 06:55:48.334887 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.334850    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:48.508004 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:48.507921    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxd2j"]
Jul 08 06:55:48.511731 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:48.511699    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a90417f_8479_4d53_aef4_55c0eb6ff45a.slice/crio-6735eba8964b63dbfcd04e9120272eb80a7629b0a64d52ce22c4757601d61f24 WatchSource:0}: Error finding container 6735eba8964b63dbfcd04e9120272eb80a7629b0a64d52ce22c4757601d61f24: Status 404 returned error can't find the container with id 6735eba8964b63dbfcd04e9120272eb80a7629b0a64d52ce22c4757601d61f24
Jul 08 06:55:49.183673 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:49.183627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxd2j" event={"ID":"1a90417f-8479-4d53-aef4-55c0eb6ff45a","Type":"ContainerStarted","Data":"6735eba8964b63dbfcd04e9120272eb80a7629b0a64d52ce22c4757601d61f24"}
Jul 08 06:55:51.196166 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:51.196128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hqdlr" event={"ID":"afe5e80d-238d-47b2-8461-4df860065087","Type":"ContainerStarted","Data":"9d88eb8eec67ad878138c5fae4a7fb19d724322c22564d8da7f595a5d5f6f6e0"}
Jul 08 06:55:51.220194 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:51.220131    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hqdlr" podStartSLOduration=65.960776326 podStartE2EDuration="1m10.220113091s" totalImagesPullingTime="4.259336765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:51.219144861 +0000 UTC m=+70.914665743" watchObservedRunningTime="2026-07-08 06:55:51.220113091 +0000 UTC m=+70.915633969"
Jul 08 06:55:52.201341 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.201306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxd2j" event={"ID":"1a90417f-8479-4d53-aef4-55c0eb6ff45a","Type":"ContainerStarted","Data":"7178dc48f47b72cfb4020368c7f0faf80f2cc303a6b7fd91ec38c3235730a0f2"}
Jul 08 06:55:52.201743 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.201357    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxd2j" event={"ID":"1a90417f-8479-4d53-aef4-55c0eb6ff45a","Type":"ContainerStarted","Data":"b8457cc420edb8e0f6a0fc60f8332be98535044f70505ab8daa3824bb7608b41"}
Jul 08 06:55:52.201743 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.201516    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:55:52.221433 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.221379    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mxd2j" podStartSLOduration=33.344953294 podStartE2EDuration="36.221361324s" totalImagesPullingTime="2.87640803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:52.219676601 +0000 UTC m=+71.915197483" watchObservedRunningTime="2026-07-08 06:55:52.221361324 +0000 UTC m=+71.916882204"
Jul 08 06:55:52.691890 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.691853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:52.691890 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.691897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:52.692524 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.692486    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d20e8ee-3269-4aad-ac44-e297ea819934-service-ca-bundle\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:52.694183 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.694160    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d20e8ee-3269-4aad-ac44-e297ea819934-metrics-certs\") pod \"router-default-86f844d7bc-p2zxg\" (UID: \"4d20e8ee-3269-4aad-ac44-e297ea819934\") " pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:52.954942 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.954858    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m85db\""
Jul 08 06:55:52.963466 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:52.963438    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:53.103782 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.103742    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86f844d7bc-p2zxg"]
Jul 08 06:55:53.106063 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:53.106037    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d20e8ee_3269_4aad_ac44_e297ea819934.slice/crio-2fcab5d7d192700307a391b8085f2d64f1fee9c068dd27f602c9d5e14dcff824 WatchSource:0}: Error finding container 2fcab5d7d192700307a391b8085f2d64f1fee9c068dd27f602c9d5e14dcff824: Status 404 returned error can't find the container with id 2fcab5d7d192700307a391b8085f2d64f1fee9c068dd27f602c9d5e14dcff824
Jul 08 06:55:53.207462 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.207356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86f844d7bc-p2zxg" event={"ID":"4d20e8ee-3269-4aad-ac44-e297ea819934","Type":"ContainerStarted","Data":"05d601b36b8383725e750c00bc52c2130b0831bf6d0c2e7b2372e079fefe55f1"}
Jul 08 06:55:53.207929 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.207462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86f844d7bc-p2zxg" event={"ID":"4d20e8ee-3269-4aad-ac44-e297ea819934","Type":"ContainerStarted","Data":"2fcab5d7d192700307a391b8085f2d64f1fee9c068dd27f602c9d5e14dcff824"}
Jul 08 06:55:53.237662 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.237596    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86f844d7bc-p2zxg" podStartSLOduration=33.23757944 podStartE2EDuration="33.23757944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:53.236911591 +0000 UTC m=+72.932432475" watchObservedRunningTime="2026-07-08 06:55:53.23757944 +0000 UTC m=+72.933100320"
Jul 08 06:55:53.245556 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.245522    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-5wxsd"]
Jul 08 06:55:53.248609 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.248592    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5wxsd"
Jul 08 06:55:53.251999 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.251976    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 06:55:53.252133 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.252110    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5f9dh\""
Jul 08 06:55:53.252201 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.252144    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 06:55:53.266979 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.266950    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5wxsd"]
Jul 08 06:55:53.337008 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.336977    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b67c57f75-zlw9z"]
Jul 08 06:55:53.340137 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.340116    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.343639 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.343616    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 06:55:53.343799 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.343659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 06:55:53.344127 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.344110    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 06:55:53.344183 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.344110    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8mxm\""
Jul 08 06:55:53.349933 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.349914    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 06:55:53.362335 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.362307    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b67c57f75-zlw9z"]
Jul 08 06:55:53.398401 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba330f19-3a1f-40e1-885d-fdb6aa72b356-ca-trust-extracted\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.398401 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba330f19-3a1f-40e1-885d-fdb6aa72b356-trusted-ca\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.398615 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-bound-sa-token\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.398615 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba330f19-3a1f-40e1-885d-fdb6aa72b356-image-registry-private-configuration\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.398615 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-registry-tls\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.398615 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398556    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svkx\" (UniqueName: \"kubernetes.io/projected/1e4a98b1-034b-4323-9659-bb39e3c91315-kube-api-access-2svkx\") pod \"downloads-685bfb5f64-5wxsd\" (UID: \"1e4a98b1-034b-4323-9659-bb39e3c91315\") " pod="openshift-console/downloads-685bfb5f64-5wxsd"
Jul 08 06:55:53.398615 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgjfp\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-kube-api-access-kgjfp\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.398615 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba330f19-3a1f-40e1-885d-fdb6aa72b356-registry-certificates\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.398834 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.398627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba330f19-3a1f-40e1-885d-fdb6aa72b356-installation-pull-secrets\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499079 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svkx\" (UniqueName: \"kubernetes.io/projected/1e4a98b1-034b-4323-9659-bb39e3c91315-kube-api-access-2svkx\") pod \"downloads-685bfb5f64-5wxsd\" (UID: \"1e4a98b1-034b-4323-9659-bb39e3c91315\") " pod="openshift-console/downloads-685bfb5f64-5wxsd"
Jul 08 06:55:53.499264 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgjfp\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-kube-api-access-kgjfp\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499329 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba330f19-3a1f-40e1-885d-fdb6aa72b356-registry-certificates\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499380 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba330f19-3a1f-40e1-885d-fdb6aa72b356-installation-pull-secrets\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499436 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba330f19-3a1f-40e1-885d-fdb6aa72b356-ca-trust-extracted\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499436 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba330f19-3a1f-40e1-885d-fdb6aa72b356-trusted-ca\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499436 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-bound-sa-token\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499582 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba330f19-3a1f-40e1-885d-fdb6aa72b356-image-registry-private-configuration\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499582 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-registry-tls\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.499877 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.499856    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba330f19-3a1f-40e1-885d-fdb6aa72b356-ca-trust-extracted\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.500264 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.500242    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba330f19-3a1f-40e1-885d-fdb6aa72b356-registry-certificates\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.500367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.500312    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba330f19-3a1f-40e1-885d-fdb6aa72b356-trusted-ca\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.502007 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.501982    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba330f19-3a1f-40e1-885d-fdb6aa72b356-image-registry-private-configuration\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.502388 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.502361    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-registry-tls\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.502458 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.502434    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba330f19-3a1f-40e1-885d-fdb6aa72b356-installation-pull-secrets\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.513689 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.513663    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgjfp\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-kube-api-access-kgjfp\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.513813 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.513704    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba330f19-3a1f-40e1-885d-fdb6aa72b356-bound-sa-token\") pod \"image-registry-6b67c57f75-zlw9z\" (UID: \"ba330f19-3a1f-40e1-885d-fdb6aa72b356\") " pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.513857 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.513841    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svkx\" (UniqueName: \"kubernetes.io/projected/1e4a98b1-034b-4323-9659-bb39e3c91315-kube-api-access-2svkx\") pod \"downloads-685bfb5f64-5wxsd\" (UID: \"1e4a98b1-034b-4323-9659-bb39e3c91315\") " pod="openshift-console/downloads-685bfb5f64-5wxsd"
Jul 08 06:55:53.557667 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.557629    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5wxsd"
Jul 08 06:55:53.651003 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.650968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:53.697586 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.697549    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5wxsd"]
Jul 08 06:55:53.700949 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:53.700920    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4a98b1_034b_4323_9659_bb39e3c91315.slice/crio-786b6b1948e5e1f03360fe23ae389dd81561fe14f0a091ecf49598f5169d2dc8 WatchSource:0}: Error finding container 786b6b1948e5e1f03360fe23ae389dd81561fe14f0a091ecf49598f5169d2dc8: Status 404 returned error can't find the container with id 786b6b1948e5e1f03360fe23ae389dd81561fe14f0a091ecf49598f5169d2dc8
Jul 08 06:55:53.791332 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.791218    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b67c57f75-zlw9z"]
Jul 08 06:55:53.795269 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:53.795242    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba330f19_3a1f_40e1_885d_fdb6aa72b356.slice/crio-889aa7916775c784ebd5ac41624c70963b90dd9be3ac329bec40c4d207b4a3df WatchSource:0}: Error finding container 889aa7916775c784ebd5ac41624c70963b90dd9be3ac329bec40c4d207b4a3df: Status 404 returned error can't find the container with id 889aa7916775c784ebd5ac41624c70963b90dd9be3ac329bec40c4d207b4a3df
Jul 08 06:55:53.964022 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.963983    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:53.966925 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:53.966896    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:54.213074 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:54.212977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z" event={"ID":"ba330f19-3a1f-40e1-885d-fdb6aa72b356","Type":"ContainerStarted","Data":"0301cd461584dd4b33499efe140c7e64db5aa6fb1ee4b4528c8ac57812fa478d"}
Jul 08 06:55:54.213074 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:54.213043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z" event={"ID":"ba330f19-3a1f-40e1-885d-fdb6aa72b356","Type":"ContainerStarted","Data":"889aa7916775c784ebd5ac41624c70963b90dd9be3ac329bec40c4d207b4a3df"}
Jul 08 06:55:54.213074 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:54.213074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:55:54.214692 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:54.214655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5wxsd" event={"ID":"1e4a98b1-034b-4323-9659-bb39e3c91315","Type":"ContainerStarted","Data":"786b6b1948e5e1f03360fe23ae389dd81561fe14f0a091ecf49598f5169d2dc8"}
Jul 08 06:55:54.214954 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:54.214934    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:54.216261 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:54.216241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86f844d7bc-p2zxg"
Jul 08 06:55:54.239366 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:54.239311    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z" podStartSLOduration=1.239288715 podStartE2EDuration="1.239288715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:54.238546106 +0000 UTC m=+73.934066987" watchObservedRunningTime="2026-07-08 06:55:54.239288715 +0000 UTC m=+73.934809577"
Jul 08 06:55:56.627289 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:56.627243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:56.640973 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:56.640943    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a45bcf29-6e71-4280-9525-84fac4d59374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhdpb\" (UID: \"a45bcf29-6e71-4280-9525-84fac4d59374\") " pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:56.840206 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:56.840174    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h6mll\""
Jul 08 06:55:56.847741 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:56.847716    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhdpb"
Jul 08 06:55:57.049561 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.049523    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhdpb"]
Jul 08 06:55:57.053493 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:55:57.053457    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45bcf29_6e71_4280_9525_84fac4d59374.slice/crio-0534a46a8789fdbbe5c4ecc0aefa78165832d57b6d7b3c0162b68ebbb9f19b7a WatchSource:0}: Error finding container 0534a46a8789fdbbe5c4ecc0aefa78165832d57b6d7b3c0162b68ebbb9f19b7a: Status 404 returned error can't find the container with id 0534a46a8789fdbbe5c4ecc0aefa78165832d57b6d7b3c0162b68ebbb9f19b7a
Jul 08 06:55:57.226693 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.226610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhdpb" event={"ID":"a45bcf29-6e71-4280-9525-84fac4d59374","Type":"ContainerStarted","Data":"0534a46a8789fdbbe5c4ecc0aefa78165832d57b6d7b3c0162b68ebbb9f19b7a"}
Jul 08 06:55:57.256203 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.256166    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58db57c9bd-4vqp4"]
Jul 08 06:55:57.286458 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.286428    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58db57c9bd-4vqp4"]
Jul 08 06:55:57.286643 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.286534    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.289192 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.289164    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 06:55:57.289330 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.289194    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rg6rq\""
Jul 08 06:55:57.289330 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.289286    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 06:55:57.289330 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.289294    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 06:55:57.290115 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.290083    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 06:55:57.290246 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.290117    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 06:55:57.294451 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.294431    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 06:55:57.440904 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.440862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-console-config\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.440904 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.440907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-trusted-ca-bundle\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.441105 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.440938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-service-ca\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.441105 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.441020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-serving-cert\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.441105 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.441062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4g4x\" (UniqueName: \"kubernetes.io/projected/5d46b3c6-608e-4f36-9437-484b50d79b99-kube-api-access-r4g4x\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.441105 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.441083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-oauth-config\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.441271 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.441133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-oauth-serving-cert\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.542860 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.542440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-console-config\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.542860 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.542493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-trusted-ca-bundle\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.542860 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.542526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-service-ca\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.542860 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.542560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-serving-cert\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.542860 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.542589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4g4x\" (UniqueName: \"kubernetes.io/projected/5d46b3c6-608e-4f36-9437-484b50d79b99-kube-api-access-r4g4x\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.542860 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.542621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-oauth-config\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.543320 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.543002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-oauth-serving-cert\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.543383 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.543366    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-service-ca\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.543435 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.543392    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-console-config\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.543704 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.543673    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-oauth-serving-cert\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.543842 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.543749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-trusted-ca-bundle\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.545698 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.545655    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-oauth-config\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.545995 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.545944    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-serving-cert\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.552082 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.552055    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4g4x\" (UniqueName: \"kubernetes.io/projected/5d46b3c6-608e-4f36-9437-484b50d79b99-kube-api-access-r4g4x\") pod \"console-58db57c9bd-4vqp4\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") " pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.601609 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.601570    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:55:57.796510 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:57.796394    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58db57c9bd-4vqp4"]
Jul 08 06:55:58.233425 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:55:58.233271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db57c9bd-4vqp4" event={"ID":"5d46b3c6-608e-4f36-9437-484b50d79b99","Type":"ContainerStarted","Data":"67701e69de3394fb3d86d88b199008b4d89c0866c539e088f58de9c554904c04"}
Jul 08 06:56:02.210580 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:02.210550    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mxd2j"
Jul 08 06:56:03.255843 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:03.255797    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhdpb" event={"ID":"a45bcf29-6e71-4280-9525-84fac4d59374","Type":"ContainerStarted","Data":"74a13ed042f72d0765be599f8b33fb3f642a7c0517f730bd81b78626eede0553"}
Jul 08 06:56:03.257469 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:03.257443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db57c9bd-4vqp4" event={"ID":"5d46b3c6-608e-4f36-9437-484b50d79b99","Type":"ContainerStarted","Data":"1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978"}
Jul 08 06:56:03.278566 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:03.278515    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58db57c9bd-4vqp4" podStartSLOduration=1.29147828 podStartE2EDuration="6.278495459s" totalImagesPullingTime="4.987017179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:03.277401418 +0000 UTC m=+82.972922300" watchObservedRunningTime="2026-07-08 06:56:03.278495459 +0000 UTC m=+82.974016340"
Jul 08 06:56:06.718951 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.718911    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"]
Jul 08 06:56:06.723896 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.723873    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.727563 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.727537    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 06:56:06.728721 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.728701    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 06:56:06.728872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.728729    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 06:56:06.728872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.728728    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 06:56:06.728872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.728728    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 06:56:06.728872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.728728    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-268dg\""
Jul 08 06:56:06.755172 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.755141    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"]
Jul 08 06:56:06.775461 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.775428    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5sp64"]
Jul 08 06:56:06.778952 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.778923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.782081 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.782056    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 06:56:06.783269 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.783241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zvxdg\""
Jul 08 06:56:06.783426 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.783406    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 06:56:06.788865 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.788846    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 06:56:06.823277 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.823238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkcnf\" (UniqueName: \"kubernetes.io/projected/39563fe0-e0ab-40fe-b584-2d0e5540646b-kube-api-access-vkcnf\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.823457 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.823310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.823457 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.823366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.823457 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.823438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39563fe0-e0ab-40fe-b584-2d0e5540646b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.830838 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.830806    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"]
Jul 08 06:56:06.834484 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.834459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:06.837372 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.837345    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 08 06:56:06.838289 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.838199    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2p4kz\""
Jul 08 06:56:06.838422 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.838298    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 08 06:56:06.838678 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.838647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 08 06:56:06.877673 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.877641    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"]
Jul 08 06:56:06.924217 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxrh4\" (UniqueName: \"kubernetes.io/projected/96b09796-5465-4b4c-9491-7b1fd5f07aa8-kube-api-access-lxrh4\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.924493 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-tls\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.924493 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4zmn\" (UniqueName: \"kubernetes.io/projected/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-api-access-t4zmn\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:06.924493 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c37e1f-2159-4423-b520-b5a69ddb16b1-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:06.924493 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0c37e1f-2159-4423-b520-b5a69ddb16b1-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:06.924493 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkcnf\" (UniqueName: \"kubernetes.io/projected/39563fe0-e0ab-40fe-b584-2d0e5540646b-kube-api-access-vkcnf\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.924493 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-textfile\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.924848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:06.924848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.924848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-sys\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.924848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:06.924848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924661    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:06.924848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.924848 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.925190 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39563fe0-e0ab-40fe-b584-2d0e5540646b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.925190 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-wtmp\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.925190 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:56:06.924942    2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 08 06:56:06.925190 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:56:06.925007    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-tls podName:39563fe0-e0ab-40fe-b584-2d0e5540646b nodeName:}" failed. No retries permitted until 2026-07-08 06:56:07.424988286 +0000 UTC m=+87.120509148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-c797f" (UID: "39563fe0-e0ab-40fe-b584-2d0e5540646b") : secret "openshift-state-metrics-tls" not found
Jul 08 06:56:06.925190 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.924945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b09796-5465-4b4c-9491-7b1fd5f07aa8-metrics-client-ca\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.925190 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.925083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.925190 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.925106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-root\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:06.925720 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.925699    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39563fe0-e0ab-40fe-b584-2d0e5540646b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.927307 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.927284    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:06.949018 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:06.948968    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkcnf\" (UniqueName: \"kubernetes.io/projected/39563fe0-e0ab-40fe-b584-2d0e5540646b-kube-api-access-vkcnf\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:07.026144 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-root\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxrh4\" (UniqueName: \"kubernetes.io/projected/96b09796-5465-4b4c-9491-7b1fd5f07aa8-kube-api-access-lxrh4\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-tls\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4zmn\" (UniqueName: \"kubernetes.io/projected/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-api-access-t4zmn\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.026377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026274    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-root\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c37e1f-2159-4423-b520-b5a69ddb16b1-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.026377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0c37e1f-2159-4423-b520-b5a69ddb16b1-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.026743 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-textfile\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026743 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.026743 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026467    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-sys\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026743 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.026966 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026839    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-textfile\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026966 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026846    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.026966 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.026966 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026917    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c37e1f-2159-4423-b520-b5a69ddb16b1-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.026966 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.027219 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.026988    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-sys\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.027219 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:56:07.027009    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 08 06:56:07.027219 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.027013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-wtmp\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.027219 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.027038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b09796-5465-4b4c-9491-7b1fd5f07aa8-metrics-client-ca\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.027219 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:56:07.027067    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-tls podName:c0c37e1f-2159-4423-b520-b5a69ddb16b1 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:07.527049907 +0000 UTC m=+87.222570766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-bhstp" (UID: "c0c37e1f-2159-4423-b520-b5a69ddb16b1") : secret "kube-state-metrics-tls" not found
Jul 08 06:56:07.027219 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.027127    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0c37e1f-2159-4423-b520-b5a69ddb16b1-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.027522 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.027283    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-wtmp\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.027522 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.027507    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b09796-5465-4b4c-9491-7b1fd5f07aa8-metrics-client-ca\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.027712 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.027681    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.029475 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.029451    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.029588 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.029459    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-tls\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.030466 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.030446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96b09796-5465-4b4c-9491-7b1fd5f07aa8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.053205 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.053178    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4zmn\" (UniqueName: \"kubernetes.io/projected/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-api-access-t4zmn\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.053205 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.053200    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxrh4\" (UniqueName: \"kubernetes.io/projected/96b09796-5465-4b4c-9491-7b1fd5f07aa8-kube-api-access-lxrh4\") pod \"node-exporter-5sp64\" (UID: \"96b09796-5465-4b4c-9491-7b1fd5f07aa8\") " pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.089731 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.089690    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5sp64"
Jul 08 06:56:07.429647 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.429548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:07.432514 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.432486    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39563fe0-e0ab-40fe-b584-2d0e5540646b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-c797f\" (UID: \"39563fe0-e0ab-40fe-b584-2d0e5540646b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:07.530147 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.530104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.532990 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.532958    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c37e1f-2159-4423-b520-b5a69ddb16b1-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bhstp\" (UID: \"c0c37e1f-2159-4423-b520-b5a69ddb16b1\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:07.601896 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.601859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:56:07.602081 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.601959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:56:07.607446 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.607420    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:56:07.634740 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.634705    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"
Jul 08 06:56:07.746082 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:07.746052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"
Jul 08 06:56:08.282236 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:08.282203    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:56:10.146051 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.146015    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79668bd5f-rrqnk"]
Jul 08 06:56:10.155561 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.155537    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.163622 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.163559    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 06:56:10.163932 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.163873    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 06:56:10.163932 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.163881    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 06:56:10.164182 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.163990    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 06:56:10.164243 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.164183    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 06:56:10.164243 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.164232    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-288dz\""
Jul 08 06:56:10.164334 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.164183    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-foq8ej7cvbq80\""
Jul 08 06:56:10.197928 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.197898    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79668bd5f-rrqnk"]
Jul 08 06:56:10.253059 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-grpc-tls\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.253241 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-tls\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.253241 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.253241 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-metrics-client-ca\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.253397 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253272    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.253397 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdf62\" (UniqueName: \"kubernetes.io/projected/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-kube-api-access-rdf62\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.253397 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.253531 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.253415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.353992 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.353950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-grpc-tls\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.354177 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.354008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-tls\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.354177 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.354128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.354293 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.354180    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-metrics-client-ca\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.354293 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.354273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.354396 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.354302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdf62\" (UniqueName: \"kubernetes.io/projected/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-kube-api-access-rdf62\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.354396 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.354335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.354396 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.354380    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.355067 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.355012    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-metrics-client-ca\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.357248 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.357197    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-grpc-tls\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.357707 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.357681    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.357959 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.357936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.357959 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.357952    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-tls\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.358100 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.357970    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.358312 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.358291    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.367050 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.367007    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdf62\" (UniqueName: \"kubernetes.io/projected/9e64d53f-76aa-4a08-8da4-3f1f552d54d7-kube-api-access-rdf62\") pod \"thanos-querier-79668bd5f-rrqnk\" (UID: \"9e64d53f-76aa-4a08-8da4-3f1f552d54d7\") " pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.467077 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.466995    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:10.659469 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:56:10.659438    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b09796_5465_4b4c_9491_7b1fd5f07aa8.slice/crio-ec23c4c032406271344277d0058ef0ed727d5c208cd41c89fb0a2ebdc14367ae WatchSource:0}: Error finding container ec23c4c032406271344277d0058ef0ed727d5c208cd41c89fb0a2ebdc14367ae: Status 404 returned error can't find the container with id ec23c4c032406271344277d0058ef0ed727d5c208cd41c89fb0a2ebdc14367ae
Jul 08 06:56:10.830197 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.830165    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f"]
Jul 08 06:56:10.841966 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:56:10.841933    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39563fe0_e0ab_40fe_b584_2d0e5540646b.slice/crio-0e2172d873cdcb0e1bee87a14974d276b8c1b64e01e8fdc200bee2d9e7af078f WatchSource:0}: Error finding container 0e2172d873cdcb0e1bee87a14974d276b8c1b64e01e8fdc200bee2d9e7af078f: Status 404 returned error can't find the container with id 0e2172d873cdcb0e1bee87a14974d276b8c1b64e01e8fdc200bee2d9e7af078f
Jul 08 06:56:10.858156 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.858123    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79668bd5f-rrqnk"]
Jul 08 06:56:10.862328 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:56:10.862301    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e64d53f_76aa_4a08_8da4_3f1f552d54d7.slice/crio-e802a8cfc472ab4ec5f11c7abc5ab2a88505f83ce37b43ede053181a26e24e46 WatchSource:0}: Error finding container e802a8cfc472ab4ec5f11c7abc5ab2a88505f83ce37b43ede053181a26e24e46: Status 404 returned error can't find the container with id e802a8cfc472ab4ec5f11c7abc5ab2a88505f83ce37b43ede053181a26e24e46
Jul 08 06:56:10.884134 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:10.884107    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp"]
Jul 08 06:56:10.887143 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:56:10.887118    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c37e1f_2159_4423_b520_b5a69ddb16b1.slice/crio-8838d93d3367135dfb421b346b4f3c624517d9a9d58dfb7568c1b5ec916717d3 WatchSource:0}: Error finding container 8838d93d3367135dfb421b346b4f3c624517d9a9d58dfb7568c1b5ec916717d3: Status 404 returned error can't find the container with id 8838d93d3367135dfb421b346b4f3c624517d9a9d58dfb7568c1b5ec916717d3
Jul 08 06:56:11.293124 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.293078    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp64" event={"ID":"96b09796-5465-4b4c-9491-7b1fd5f07aa8","Type":"ContainerStarted","Data":"ec23c4c032406271344277d0058ef0ed727d5c208cd41c89fb0a2ebdc14367ae"}
Jul 08 06:56:11.296326 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.295599    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5wxsd" event={"ID":"1e4a98b1-034b-4323-9659-bb39e3c91315","Type":"ContainerStarted","Data":"e0b316e4e5c4d3882c0691a60460e843e9f88601737f6e991102785b518421f2"}
Jul 08 06:56:11.296539 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.296514    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-5wxsd"
Jul 08 06:56:11.301213 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.301187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhdpb" event={"ID":"a45bcf29-6e71-4280-9525-84fac4d59374","Type":"ContainerStarted","Data":"c28b9e2e5dd77c170868338ce90054f54cf05a2149812cd4085dd4ca6a13df4b"}
Jul 08 06:56:11.305052 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.304994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp" event={"ID":"c0c37e1f-2159-4423-b520-b5a69ddb16b1","Type":"ContainerStarted","Data":"8838d93d3367135dfb421b346b4f3c624517d9a9d58dfb7568c1b5ec916717d3"}
Jul 08 06:56:11.306946 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.306919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" event={"ID":"9e64d53f-76aa-4a08-8da4-3f1f552d54d7","Type":"ContainerStarted","Data":"e802a8cfc472ab4ec5f11c7abc5ab2a88505f83ce37b43ede053181a26e24e46"}
Jul 08 06:56:11.307377 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.307323    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-5wxsd"
Jul 08 06:56:11.310608 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.310401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f" event={"ID":"39563fe0-e0ab-40fe-b584-2d0e5540646b","Type":"ContainerStarted","Data":"b2effc69c52ac0be9fe6aa27fe103f33753ff49725284dc753c3d5967537fc72"}
Jul 08 06:56:11.310608 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.310459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f" event={"ID":"39563fe0-e0ab-40fe-b584-2d0e5540646b","Type":"ContainerStarted","Data":"5673a2c1f7184d2976b961340564d8dd20a615c4df48b8c2e3ee39ca4d10fcfe"}
Jul 08 06:56:11.310608 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.310487    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f" event={"ID":"39563fe0-e0ab-40fe-b584-2d0e5540646b","Type":"ContainerStarted","Data":"0e2172d873cdcb0e1bee87a14974d276b8c1b64e01e8fdc200bee2d9e7af078f"}
Jul 08 06:56:11.362209 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.362139    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-5wxsd" podStartSLOduration=1.152453566 podStartE2EDuration="18.362114337s" totalImagesPullingTime="17.209660771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:11.328176388 +0000 UTC m=+91.023697290" watchObservedRunningTime="2026-07-08 06:56:11.362114337 +0000 UTC m=+91.057635219"
Jul 08 06:56:11.438791 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.438716    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"]
Jul 08 06:56:11.442523 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.442467    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:11.445424 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.445395    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 06:56:11.445806 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.445783    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f4l5k\""
Jul 08 06:56:11.456219 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.456153    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"]
Jul 08 06:56:11.565178 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.564956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a895408b-f55b-495d-b677-5e4dc9d4dc81-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-vnppc\" (UID: \"a895408b-f55b-495d-b677-5e4dc9d4dc81\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:11.565178 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.565016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw55g\" (UniqueName: \"kubernetes.io/projected/a895408b-f55b-495d-b677-5e4dc9d4dc81-kube-api-access-mw55g\") pod \"monitoring-plugin-d5dcff7cf-vnppc\" (UID: \"a895408b-f55b-495d-b677-5e4dc9d4dc81\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:11.669656 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.668853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw55g\" (UniqueName: \"kubernetes.io/projected/a895408b-f55b-495d-b677-5e4dc9d4dc81-kube-api-access-mw55g\") pod \"monitoring-plugin-d5dcff7cf-vnppc\" (UID: \"a895408b-f55b-495d-b677-5e4dc9d4dc81\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:11.670651 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.670408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a895408b-f55b-495d-b677-5e4dc9d4dc81-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-vnppc\" (UID: \"a895408b-f55b-495d-b677-5e4dc9d4dc81\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:11.683102 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.683036    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a895408b-f55b-495d-b677-5e4dc9d4dc81-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-vnppc\" (UID: \"a895408b-f55b-495d-b677-5e4dc9d4dc81\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:11.707236 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.706185    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw55g\" (UniqueName: \"kubernetes.io/projected/a895408b-f55b-495d-b677-5e4dc9d4dc81-kube-api-access-mw55g\") pod \"monitoring-plugin-d5dcff7cf-vnppc\" (UID: \"a895408b-f55b-495d-b677-5e4dc9d4dc81\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:11.757756 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:11.757452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:12.520444 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:12.520401    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"]
Jul 08 06:56:13.325188 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.325035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc" event={"ID":"a895408b-f55b-495d-b677-5e4dc9d4dc81","Type":"ContainerStarted","Data":"6c29e66e4bc98b947ddd6e270a92a0d6cf44eec3616b4556bc9bc8bad8b52690"}
Jul 08 06:56:13.848008 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.847664    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4b56fc7c-hmd5q"]
Jul 08 06:56:13.871721 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.871677    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4b56fc7c-hmd5q"]
Jul 08 06:56:13.871905 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.871846    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.894668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.894389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-trusted-ca-bundle\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.894668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.894455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-oauth-config\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.894668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.894489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-service-ca\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.894668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.894527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-serving-cert\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.894668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.894559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-console-config\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.894668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.894581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrv9\" (UniqueName: \"kubernetes.io/projected/75e10f24-654c-4936-a877-7d69d4f8cc42-kube-api-access-gvrv9\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.894668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.894631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-oauth-serving-cert\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.995983 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.995939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-trusted-ca-bundle\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.996165 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.996011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-oauth-config\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.996165 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.996034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-service-ca\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.996165 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.996068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-serving-cert\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.996165 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.996151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-console-config\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.996367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.996188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrv9\" (UniqueName: \"kubernetes.io/projected/75e10f24-654c-4936-a877-7d69d4f8cc42-kube-api-access-gvrv9\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.996367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.996285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-oauth-serving-cert\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.997129 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.997099    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-trusted-ca-bundle\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.997457 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.997431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-oauth-serving-cert\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.997554 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.997437    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-service-ca\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.997880 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.997856    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-console-config\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.999086 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.999059    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-oauth-config\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:13.999476 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:13.999453    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-serving-cert\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:14.005101 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:14.005075    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrv9\" (UniqueName: \"kubernetes.io/projected/75e10f24-654c-4936-a877-7d69d4f8cc42-kube-api-access-gvrv9\") pod \"console-5b4b56fc7c-hmd5q\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") " pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:14.185650 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:14.185511    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:15.224343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:15.224244    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b67c57f75-zlw9z"
Jul 08 06:56:17.390695 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:17.390659    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4b56fc7c-hmd5q"]
Jul 08 06:56:18.180888 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.180816    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tttrr"
Jul 08 06:56:18.353275 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.353237    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" event={"ID":"9e64d53f-76aa-4a08-8da4-3f1f552d54d7","Type":"ContainerStarted","Data":"22b89b53b0c1d08270ad9263dd7b90505d4ee2a65a7ce61d7c754d39b990954f"}
Jul 08 06:56:18.353463 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.353320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" event={"ID":"9e64d53f-76aa-4a08-8da4-3f1f552d54d7","Type":"ContainerStarted","Data":"9a502693e87b21a65943a9d2a7d51721a93c80df585289c8e5626b20f48e6616"}
Jul 08 06:56:18.353463 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.353376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" event={"ID":"9e64d53f-76aa-4a08-8da4-3f1f552d54d7","Type":"ContainerStarted","Data":"953b5d9b9d7706b70c96225375aab700783667a995ee84eeba109dc904f4349b"}
Jul 08 06:56:18.355832 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.355798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f" event={"ID":"39563fe0-e0ab-40fe-b584-2d0e5540646b","Type":"ContainerStarted","Data":"5827ff7c87ed708b2d4003d45f88c7b0717898c44bf8918d5d15ffec0611aa77"}
Jul 08 06:56:18.357595 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.357568    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc" event={"ID":"a895408b-f55b-495d-b677-5e4dc9d4dc81","Type":"ContainerStarted","Data":"858956437d7ad54b07f3ba624416717b24237782024dcc02e1e0bfb272fd667b"}
Jul 08 06:56:18.357798 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.357754    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:18.359475 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.359448    2573 generic.go:356] "Generic (PLEG): container finished" podID="96b09796-5465-4b4c-9491-7b1fd5f07aa8" containerID="d5f2823b36ee756aa66585b98e8721b03d1b1367165e4759a543593f352104d6" exitCode=0
Jul 08 06:56:18.359594 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.359537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp64" event={"ID":"96b09796-5465-4b4c-9491-7b1fd5f07aa8","Type":"ContainerDied","Data":"d5f2823b36ee756aa66585b98e8721b03d1b1367165e4759a543593f352104d6"}
Jul 08 06:56:18.361997 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.361973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b56fc7c-hmd5q" event={"ID":"75e10f24-654c-4936-a877-7d69d4f8cc42","Type":"ContainerStarted","Data":"4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700"}
Jul 08 06:56:18.362198 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.362179    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b56fc7c-hmd5q" event={"ID":"75e10f24-654c-4936-a877-7d69d4f8cc42","Type":"ContainerStarted","Data":"e0375f621790bfa08c722251ea45fa11b9fd8fcb3694fde58c60cb9ba8e8df11"}
Jul 08 06:56:18.364583 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.364546    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc"
Jul 08 06:56:18.366696 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.366670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhdpb" event={"ID":"a45bcf29-6e71-4280-9525-84fac4d59374","Type":"ContainerStarted","Data":"8ec45305ee2b514aa0f692d6af2cbbcfc16ae7a3cabe4e0bd525fae775c62fc5"}
Jul 08 06:56:18.369207 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.369183    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp" event={"ID":"c0c37e1f-2159-4423-b520-b5a69ddb16b1","Type":"ContainerStarted","Data":"141c287922dfb320e84eb611d4d03bb7745d8f80ce7b0e8263cfb06f67d73e61"}
Jul 08 06:56:18.369310 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.369229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp" event={"ID":"c0c37e1f-2159-4423-b520-b5a69ddb16b1","Type":"ContainerStarted","Data":"3baa9d9d6bfd5ead987d5f404bc67796b276391d0456967f91d873b757d4df50"}
Jul 08 06:56:18.369310 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.369251    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp" event={"ID":"c0c37e1f-2159-4423-b520-b5a69ddb16b1","Type":"ContainerStarted","Data":"7d0a3456bfb8386728f1ebb2952f4ab87ad34ed4010ea9dcf30d3985b0658759"}
Jul 08 06:56:18.375009 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.374967    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-c797f" podStartSLOduration=6.140160515 podStartE2EDuration="12.374954615s" totalImagesPullingTime="6.2347941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.373455036 +0000 UTC m=+98.068975931" watchObservedRunningTime="2026-07-08 06:56:18.374954615 +0000 UTC m=+98.070475496"
Jul 08 06:56:18.391796 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.391679    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bhstp" podStartSLOduration=6.059146248 podStartE2EDuration="12.391658895s" totalImagesPullingTime="6.332512647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.390901627 +0000 UTC m=+98.086422508" watchObservedRunningTime="2026-07-08 06:56:18.391658895 +0000 UTC m=+98.087179755"
Jul 08 06:56:18.407642 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.407188    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vnppc" podStartSLOduration=2.364643754 podStartE2EDuration="7.407168073s" totalImagesPullingTime="5.042524319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.406327281 +0000 UTC m=+98.101848174" watchObservedRunningTime="2026-07-08 06:56:18.407168073 +0000 UTC m=+98.102688956"
Jul 08 06:56:18.450640 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.450580    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4b56fc7c-hmd5q" podStartSLOduration=5.450560551 podStartE2EDuration="5.450560551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.430574875 +0000 UTC m=+98.126095759" watchObservedRunningTime="2026-07-08 06:56:18.450560551 +0000 UTC m=+98.146081411"
Jul 08 06:56:18.450954 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:18.450918    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jhdpb" podStartSLOduration=34.465036842 podStartE2EDuration="54.450907349s" totalImagesPullingTime="19.985870507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:18.4486985 +0000 UTC m=+98.144219394" watchObservedRunningTime="2026-07-08 06:56:18.450907349 +0000 UTC m=+98.146428231"
Jul 08 06:56:19.377413 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:19.377365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" event={"ID":"9e64d53f-76aa-4a08-8da4-3f1f552d54d7","Type":"ContainerStarted","Data":"04ecbb524f1eabeca654694242c882005505c87ef06a3e629b55f4d94daaae19"}
Jul 08 06:56:19.380195 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:19.380163    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp64" event={"ID":"96b09796-5465-4b4c-9491-7b1fd5f07aa8","Type":"ContainerStarted","Data":"0ccb327c5b05c4e8b35492b5f55962d4b4814024efc71f557d45b2e285119541"}
Jul 08 06:56:19.380343 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:19.380220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sp64" event={"ID":"96b09796-5465-4b4c-9491-7b1fd5f07aa8","Type":"ContainerStarted","Data":"75103026d242b8b948865c881d0fb731da140016168ee52dbfdb8be06664d698"}
Jul 08 06:56:19.399990 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:19.399935    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5sp64" podStartSLOduration=6.729324166 podStartE2EDuration="13.399918248s" totalImagesPullingTime="6.550616923s" totalInitContainerRuntime="119.977159ms" isStatefulPod=true podCreationTimestamp="2026-07-08 06:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:19.39937708 +0000 UTC m=+99.094897963" watchObservedRunningTime="2026-07-08 06:56:19.399918248 +0000 UTC m=+99.095439130"
Jul 08 06:56:20.387312 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:20.387271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" event={"ID":"9e64d53f-76aa-4a08-8da4-3f1f552d54d7","Type":"ContainerStarted","Data":"750be9a5f341f1459b4fbffd3fcf82ba397911193bf23bda76ac9f25539aa429"}
Jul 08 06:56:20.387611 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:20.387348    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" event={"ID":"9e64d53f-76aa-4a08-8da4-3f1f552d54d7","Type":"ContainerStarted","Data":"b6c77b33d1a1c002ea9f1bfc2f3495a8ac4ed588911109d98b60cc510084b1e8"}
Jul 08 06:56:20.411928 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:20.411862    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk" podStartSLOduration=2.715382997 podStartE2EDuration="10.411841002s" totalImagesPullingTime="7.696458005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:20.410470122 +0000 UTC m=+100.105991002" watchObservedRunningTime="2026-07-08 06:56:20.411841002 +0000 UTC m=+100.107361884"
Jul 08 06:56:21.395137 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:21.393480    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:22.401579 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:22.401556    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79668bd5f-rrqnk"
Jul 08 06:56:24.186418 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:24.186383    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:24.186833 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:24.186440    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:24.191200 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:24.191177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:24.407298 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:24.407270    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:56:24.450094 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:24.450004    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58db57c9bd-4vqp4"]
Jul 08 06:56:31.435048 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:31.435009    2573 generic.go:356] "Generic (PLEG): container finished" podID="b230a624-c0e3-4929-b785-7186cb82f537" containerID="1a5f9839487076f2f31caf33bd8d328bc3237a104c1613836895e9b58c5692cf" exitCode=0
Jul 08 06:56:31.435581 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:31.435052    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f" event={"ID":"b230a624-c0e3-4929-b785-7186cb82f537","Type":"ContainerDied","Data":"1a5f9839487076f2f31caf33bd8d328bc3237a104c1613836895e9b58c5692cf"}
Jul 08 06:56:31.435581 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:31.435450    2573 scope.go:117] "RemoveContainer" containerID="1a5f9839487076f2f31caf33bd8d328bc3237a104c1613836895e9b58c5692cf"
Jul 08 06:56:32.441144 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:32.441109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xps6f" event={"ID":"b230a624-c0e3-4929-b785-7186cb82f537","Type":"ContainerStarted","Data":"e3de70ba233ebefccc5ecb1ee5432389f83a930588c5195a1bb8cc3e1f63f850"}
Jul 08 06:56:49.474380 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.474338    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58db57c9bd-4vqp4" podUID="5d46b3c6-608e-4f36-9437-484b50d79b99" containerName="console" containerID="cri-o://1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978" gracePeriod=15
Jul 08 06:56:49.754569 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.754532    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:56:49.916226 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916187    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-console-config\") pod \"5d46b3c6-608e-4f36-9437-484b50d79b99\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") "
Jul 08 06:56:49.916400 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916239    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4g4x\" (UniqueName: \"kubernetes.io/projected/5d46b3c6-608e-4f36-9437-484b50d79b99-kube-api-access-r4g4x\") pod \"5d46b3c6-608e-4f36-9437-484b50d79b99\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") "
Jul 08 06:56:49.916400 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916270    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-oauth-config\") pod \"5d46b3c6-608e-4f36-9437-484b50d79b99\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") "
Jul 08 06:56:49.916400 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916323    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-trusted-ca-bundle\") pod \"5d46b3c6-608e-4f36-9437-484b50d79b99\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") "
Jul 08 06:56:49.916400 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916374    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-oauth-serving-cert\") pod \"5d46b3c6-608e-4f36-9437-484b50d79b99\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") "
Jul 08 06:56:49.916582 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916405    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-service-ca\") pod \"5d46b3c6-608e-4f36-9437-484b50d79b99\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") "
Jul 08 06:56:49.916582 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-serving-cert\") pod \"5d46b3c6-608e-4f36-9437-484b50d79b99\" (UID: \"5d46b3c6-608e-4f36-9437-484b50d79b99\") "
Jul 08 06:56:49.916750 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916643    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-console-config" (OuterVolumeSpecName: "console-config") pod "5d46b3c6-608e-4f36-9437-484b50d79b99" (UID: "5d46b3c6-608e-4f36-9437-484b50d79b99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:49.916957 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916927    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d46b3c6-608e-4f36-9437-484b50d79b99" (UID: "5d46b3c6-608e-4f36-9437-484b50d79b99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:49.917039 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916973    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d46b3c6-608e-4f36-9437-484b50d79b99" (UID: "5d46b3c6-608e-4f36-9437-484b50d79b99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:49.917039 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.916995    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d46b3c6-608e-4f36-9437-484b50d79b99" (UID: "5d46b3c6-608e-4f36-9437-484b50d79b99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:56:49.918797 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.918758    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d46b3c6-608e-4f36-9437-484b50d79b99" (UID: "5d46b3c6-608e-4f36-9437-484b50d79b99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:56:49.918933 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.918917    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d46b3c6-608e-4f36-9437-484b50d79b99" (UID: "5d46b3c6-608e-4f36-9437-484b50d79b99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:56:49.918976 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:49.918937    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d46b3c6-608e-4f36-9437-484b50d79b99-kube-api-access-r4g4x" (OuterVolumeSpecName: "kube-api-access-r4g4x") pod "5d46b3c6-608e-4f36-9437-484b50d79b99" (UID: "5d46b3c6-608e-4f36-9437-484b50d79b99"). InnerVolumeSpecName "kube-api-access-r4g4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:56:50.017389 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.017301    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-oauth-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:56:50.017389 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.017331    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-service-ca\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:56:50.017389 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.017341    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:56:50.017389 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.017350    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-console-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:56:50.017389 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.017360    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4g4x\" (UniqueName: \"kubernetes.io/projected/5d46b3c6-608e-4f36-9437-484b50d79b99-kube-api-access-r4g4x\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:56:50.017389 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.017369    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d46b3c6-608e-4f36-9437-484b50d79b99-console-oauth-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:56:50.017389 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.017377    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d46b3c6-608e-4f36-9437-484b50d79b99-trusted-ca-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:56:50.511549 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.511515    2573 generic.go:356] "Generic (PLEG): container finished" podID="5d46b3c6-608e-4f36-9437-484b50d79b99" containerID="1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978" exitCode=0
Jul 08 06:56:50.512052 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.511565    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db57c9bd-4vqp4"
Jul 08 06:56:50.512052 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.511592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db57c9bd-4vqp4" event={"ID":"5d46b3c6-608e-4f36-9437-484b50d79b99","Type":"ContainerDied","Data":"1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978"}
Jul 08 06:56:50.512052 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.511642    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db57c9bd-4vqp4" event={"ID":"5d46b3c6-608e-4f36-9437-484b50d79b99","Type":"ContainerDied","Data":"67701e69de3394fb3d86d88b199008b4d89c0866c539e088f58de9c554904c04"}
Jul 08 06:56:50.512052 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.511662    2573 scope.go:117] "RemoveContainer" containerID="1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978"
Jul 08 06:56:50.520737 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.520719    2573 scope.go:117] "RemoveContainer" containerID="1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978"
Jul 08 06:56:50.521072 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:56:50.521053    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978\": container with ID starting with 1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978 not found: ID does not exist" containerID="1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978"
Jul 08 06:56:50.521137 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.521082    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978"} err="failed to get container status \"1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978\": rpc error: code = NotFound desc = could not find container \"1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978\": container with ID starting with 1597bf392095c6e74c9c7e089638e1123cae67b6c59e2e45f5a9465396f36978 not found: ID does not exist"
Jul 08 06:56:50.532573 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.532542    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58db57c9bd-4vqp4"]
Jul 08 06:56:50.536872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.536848    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58db57c9bd-4vqp4"]
Jul 08 06:56:50.824691 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:56:50.824605    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d46b3c6-608e-4f36-9437-484b50d79b99" path="/var/lib/kubelet/pods/5d46b3c6-608e-4f36-9437-484b50d79b99/volumes"
Jul 08 06:57:35.597926 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.597843    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-658f8dfc7b-5gm4g"]
Jul 08 06:57:35.598367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.598270    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d46b3c6-608e-4f36-9437-484b50d79b99" containerName="console"
Jul 08 06:57:35.598367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.598285    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d46b3c6-608e-4f36-9437-484b50d79b99" containerName="console"
Jul 08 06:57:35.598367 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.598343    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d46b3c6-608e-4f36-9437-484b50d79b99" containerName="console"
Jul 08 06:57:35.601599 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.601577    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.613188 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.613162    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658f8dfc7b-5gm4g"]
Jul 08 06:57:35.685579 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.685540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-oauth-config\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.685579 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.685578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-console-config\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.685831 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.685596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zql9\" (UniqueName: \"kubernetes.io/projected/915487b3-fb49-40e4-b438-71344b88a211-kube-api-access-9zql9\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.685831 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.685654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-serving-cert\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.685831 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.685674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-oauth-serving-cert\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.685831 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.685726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-service-ca\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.685831 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.685803    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-trusted-ca-bundle\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.786997 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.786961    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-trusted-ca-bundle\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.787160 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-oauth-config\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.787160 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-console-config\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.787160 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zql9\" (UniqueName: \"kubernetes.io/projected/915487b3-fb49-40e4-b438-71344b88a211-kube-api-access-9zql9\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.787160 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-serving-cert\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.787160 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-oauth-serving-cert\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.787405 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-service-ca\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.787893 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787866    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-console-config\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.788015 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.787876    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-service-ca\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.788269 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.788242    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-trusted-ca-bundle\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.788350 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.788242    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-oauth-serving-cert\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.789541 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.789511    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-serving-cert\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.789541 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.789539    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-oauth-config\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.796037 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.796012    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zql9\" (UniqueName: \"kubernetes.io/projected/915487b3-fb49-40e4-b438-71344b88a211-kube-api-access-9zql9\") pod \"console-658f8dfc7b-5gm4g\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") " pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:35.911012 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:35.910916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:36.043890 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:36.043856    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658f8dfc7b-5gm4g"]
Jul 08 06:57:36.047240 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:57:36.047204    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915487b3_fb49_40e4_b438_71344b88a211.slice/crio-46fee2ba3af128371255fe83116d1b1b87e1e50e7e6efc79417b4fafc1578d8e WatchSource:0}: Error finding container 46fee2ba3af128371255fe83116d1b1b87e1e50e7e6efc79417b4fafc1578d8e: Status 404 returned error can't find the container with id 46fee2ba3af128371255fe83116d1b1b87e1e50e7e6efc79417b4fafc1578d8e
Jul 08 06:57:36.688231 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:36.688199    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f8dfc7b-5gm4g" event={"ID":"915487b3-fb49-40e4-b438-71344b88a211","Type":"ContainerStarted","Data":"1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c"}
Jul 08 06:57:36.688594 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:36.688244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f8dfc7b-5gm4g" event={"ID":"915487b3-fb49-40e4-b438-71344b88a211","Type":"ContainerStarted","Data":"46fee2ba3af128371255fe83116d1b1b87e1e50e7e6efc79417b4fafc1578d8e"}
Jul 08 06:57:36.706842 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:36.706787    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-658f8dfc7b-5gm4g" podStartSLOduration=1.706750226 podStartE2EDuration="1.706750226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:57:36.705174894 +0000 UTC m=+176.400695774" watchObservedRunningTime="2026-07-08 06:57:36.706750226 +0000 UTC m=+176.402271155"
Jul 08 06:57:45.912045 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:45.912009    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:45.912499 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:45.912063    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:45.916784 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:45.916747    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:46.731103 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:46.731073    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:57:46.781134 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:57:46.779806    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4b56fc7c-hmd5q"]
Jul 08 06:58:11.809472 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:11.809401    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b4b56fc7c-hmd5q" podUID="75e10f24-654c-4936-a877-7d69d4f8cc42" containerName="console" containerID="cri-o://4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700" gracePeriod=15
Jul 08 06:58:12.053991 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.053968    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:58:12.199811 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.199695    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-trusted-ca-bundle\") pod \"75e10f24-654c-4936-a877-7d69d4f8cc42\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") "
Jul 08 06:58:12.199811 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.199737    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-oauth-config\") pod \"75e10f24-654c-4936-a877-7d69d4f8cc42\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") "
Jul 08 06:58:12.199811 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.199785    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-oauth-serving-cert\") pod \"75e10f24-654c-4936-a877-7d69d4f8cc42\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") "
Jul 08 06:58:12.199811 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.199816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-serving-cert\") pod \"75e10f24-654c-4936-a877-7d69d4f8cc42\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") "
Jul 08 06:58:12.200126 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.199841    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-service-ca\") pod \"75e10f24-654c-4936-a877-7d69d4f8cc42\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") "
Jul 08 06:58:12.200126 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.199862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvrv9\" (UniqueName: \"kubernetes.io/projected/75e10f24-654c-4936-a877-7d69d4f8cc42-kube-api-access-gvrv9\") pod \"75e10f24-654c-4936-a877-7d69d4f8cc42\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") "
Jul 08 06:58:12.200126 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.200068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-console-config\") pod \"75e10f24-654c-4936-a877-7d69d4f8cc42\" (UID: \"75e10f24-654c-4936-a877-7d69d4f8cc42\") "
Jul 08 06:58:12.200274 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.200245    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75e10f24-654c-4936-a877-7d69d4f8cc42" (UID: "75e10f24-654c-4936-a877-7d69d4f8cc42"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:12.200379 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.200356    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-oauth-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:58:12.200510 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.200426    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-service-ca" (OuterVolumeSpecName: "service-ca") pod "75e10f24-654c-4936-a877-7d69d4f8cc42" (UID: "75e10f24-654c-4936-a877-7d69d4f8cc42"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:12.200510 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.200453    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-console-config" (OuterVolumeSpecName: "console-config") pod "75e10f24-654c-4936-a877-7d69d4f8cc42" (UID: "75e10f24-654c-4936-a877-7d69d4f8cc42"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:12.200510 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.200465    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "75e10f24-654c-4936-a877-7d69d4f8cc42" (UID: "75e10f24-654c-4936-a877-7d69d4f8cc42"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:12.202117 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.202094    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75e10f24-654c-4936-a877-7d69d4f8cc42" (UID: "75e10f24-654c-4936-a877-7d69d4f8cc42"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:12.202117 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.202109    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75e10f24-654c-4936-a877-7d69d4f8cc42" (UID: "75e10f24-654c-4936-a877-7d69d4f8cc42"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:12.202238 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.202199    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e10f24-654c-4936-a877-7d69d4f8cc42-kube-api-access-gvrv9" (OuterVolumeSpecName: "kube-api-access-gvrv9") pod "75e10f24-654c-4936-a877-7d69d4f8cc42" (UID: "75e10f24-654c-4936-a877-7d69d4f8cc42"). InnerVolumeSpecName "kube-api-access-gvrv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:58:12.300946 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.300910    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-oauth-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:58:12.300946 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.300938    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e10f24-654c-4936-a877-7d69d4f8cc42-console-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:58:12.300946 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.300950    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-service-ca\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:58:12.301163 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.300959    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvrv9\" (UniqueName: \"kubernetes.io/projected/75e10f24-654c-4936-a877-7d69d4f8cc42-kube-api-access-gvrv9\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:58:12.301163 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.300968    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-console-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:58:12.301163 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.300976    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e10f24-654c-4936-a877-7d69d4f8cc42-trusted-ca-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:58:12.824796 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.824745    2573 generic.go:356] "Generic (PLEG): container finished" podID="75e10f24-654c-4936-a877-7d69d4f8cc42" containerID="4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700" exitCode=0
Jul 08 06:58:12.825260 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.824809    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4b56fc7c-hmd5q"
Jul 08 06:58:12.825260 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.824838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b56fc7c-hmd5q" event={"ID":"75e10f24-654c-4936-a877-7d69d4f8cc42","Type":"ContainerDied","Data":"4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700"}
Jul 08 06:58:12.825260 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.824904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4b56fc7c-hmd5q" event={"ID":"75e10f24-654c-4936-a877-7d69d4f8cc42","Type":"ContainerDied","Data":"e0375f621790bfa08c722251ea45fa11b9fd8fcb3694fde58c60cb9ba8e8df11"}
Jul 08 06:58:12.825260 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.824939    2573 scope.go:117] "RemoveContainer" containerID="4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700"
Jul 08 06:58:12.834351 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.834331    2573 scope.go:117] "RemoveContainer" containerID="4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700"
Jul 08 06:58:12.834615 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:58:12.834596    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700\": container with ID starting with 4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700 not found: ID does not exist" containerID="4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700"
Jul 08 06:58:12.834682 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.834624    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700"} err="failed to get container status \"4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700\": rpc error: code = NotFound desc = could not find container \"4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700\": container with ID starting with 4eb78e455a0d9cd49d30a7a89171beb253ac03917088dfa40a5fa48cc9d75700 not found: ID does not exist"
Jul 08 06:58:12.843734 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.843711    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4b56fc7c-hmd5q"]
Jul 08 06:58:12.847336 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:12.847311    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4b56fc7c-hmd5q"]
Jul 08 06:58:14.820108 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:14.820077    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75e10f24-654c-4936-a877-7d69d4f8cc42" path="/var/lib/kubelet/pods/75e10f24-654c-4936-a877-7d69d4f8cc42/volumes"
Jul 08 06:58:46.536754 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.536717    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f66b95d4-wbctg"]
Jul 08 06:58:46.537260 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.537046    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e10f24-654c-4936-a877-7d69d4f8cc42" containerName="console"
Jul 08 06:58:46.537260 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.537058    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e10f24-654c-4936-a877-7d69d4f8cc42" containerName="console"
Jul 08 06:58:46.537260 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.537112    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="75e10f24-654c-4936-a877-7d69d4f8cc42" containerName="console"
Jul 08 06:58:46.541360 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.541332    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.551787 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.551750    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f66b95d4-wbctg"]
Jul 08 06:58:46.684153 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.684109    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9sc\" (UniqueName: \"kubernetes.io/projected/824707dd-686f-4622-986a-70f0a3aac092-kube-api-access-nz9sc\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.684153 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.684155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-trusted-ca-bundle\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.684361 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.684174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-console-config\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.684361 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.684191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-oauth-serving-cert\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.684361 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.684275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-oauth-config\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.684361 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.684333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-serving-cert\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.684361 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.684352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-service-ca\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.784962 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.784924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-console-config\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.784962 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.784962    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-oauth-serving-cert\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785162 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-oauth-config\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785208 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-serving-cert\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785208 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-service-ca\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9sc\" (UniqueName: \"kubernetes.io/projected/824707dd-686f-4622-986a-70f0a3aac092-kube-api-access-nz9sc\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785297 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-trusted-ca-bundle\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785731 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785703    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-console-config\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785882 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-oauth-serving-cert\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.785882 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.785862    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-service-ca\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.786241 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.786223    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-trusted-ca-bundle\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.787611 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.787553    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-oauth-config\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.787715 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.787699    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-serving-cert\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.792721 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.792700    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9sc\" (UniqueName: \"kubernetes.io/projected/824707dd-686f-4622-986a-70f0a3aac092-kube-api-access-nz9sc\") pod \"console-85f66b95d4-wbctg\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") " pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.850917 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.850886    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:46.981427 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:46.981395    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f66b95d4-wbctg"]
Jul 08 06:58:46.984341 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:58:46.984313    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824707dd_686f_4622_986a_70f0a3aac092.slice/crio-ffdeeba7fcc94c07d4944d8a2fb105c19c045dbc35f63523108527c2784b11d1 WatchSource:0}: Error finding container ffdeeba7fcc94c07d4944d8a2fb105c19c045dbc35f63523108527c2784b11d1: Status 404 returned error can't find the container with id ffdeeba7fcc94c07d4944d8a2fb105c19c045dbc35f63523108527c2784b11d1
Jul 08 06:58:47.964284 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:47.964247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f66b95d4-wbctg" event={"ID":"824707dd-686f-4622-986a-70f0a3aac092","Type":"ContainerStarted","Data":"5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079"}
Jul 08 06:58:47.964660 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:47.964299    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f66b95d4-wbctg" event={"ID":"824707dd-686f-4622-986a-70f0a3aac092","Type":"ContainerStarted","Data":"ffdeeba7fcc94c07d4944d8a2fb105c19c045dbc35f63523108527c2784b11d1"}
Jul 08 06:58:47.981536 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:47.981480    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f66b95d4-wbctg" podStartSLOduration=1.9814528249999999 podStartE2EDuration="1.981452825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:58:47.981044128 +0000 UTC m=+247.676565008" watchObservedRunningTime="2026-07-08 06:58:47.981452825 +0000 UTC m=+247.676973709"
Jul 08 06:58:56.851871 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:56.851841    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:56.852290 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:56.851891    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:56.856991 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:56.856967    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:57.002616 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:57.002585    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 06:58:57.051259 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:58:57.051225    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658f8dfc7b-5gm4g"]
Jul 08 06:59:22.078826 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.078736    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-658f8dfc7b-5gm4g" podUID="915487b3-fb49-40e4-b438-71344b88a211" containerName="console" containerID="cri-o://1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c" gracePeriod=15
Jul 08 06:59:22.321412 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.321383    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:59:22.370585 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370495    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-service-ca\") pod \"915487b3-fb49-40e4-b438-71344b88a211\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") "
Jul 08 06:59:22.370585 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-console-config\") pod \"915487b3-fb49-40e4-b438-71344b88a211\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") "
Jul 08 06:59:22.370805 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370597    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-trusted-ca-bundle\") pod \"915487b3-fb49-40e4-b438-71344b88a211\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") "
Jul 08 06:59:22.370805 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370646    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-oauth-config\") pod \"915487b3-fb49-40e4-b438-71344b88a211\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") "
Jul 08 06:59:22.370915 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370838    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-oauth-serving-cert\") pod \"915487b3-fb49-40e4-b438-71344b88a211\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") "
Jul 08 06:59:22.370915 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370904    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zql9\" (UniqueName: \"kubernetes.io/projected/915487b3-fb49-40e4-b438-71344b88a211-kube-api-access-9zql9\") pod \"915487b3-fb49-40e4-b438-71344b88a211\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") "
Jul 08 06:59:22.371017 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-serving-cert\") pod \"915487b3-fb49-40e4-b438-71344b88a211\" (UID: \"915487b3-fb49-40e4-b438-71344b88a211\") "
Jul 08 06:59:22.371163 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.370989    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-service-ca" (OuterVolumeSpecName: "service-ca") pod "915487b3-fb49-40e4-b438-71344b88a211" (UID: "915487b3-fb49-40e4-b438-71344b88a211"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:59:22.371163 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.371104    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "915487b3-fb49-40e4-b438-71344b88a211" (UID: "915487b3-fb49-40e4-b438-71344b88a211"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:59:22.371163 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.371113    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-console-config" (OuterVolumeSpecName: "console-config") pod "915487b3-fb49-40e4-b438-71344b88a211" (UID: "915487b3-fb49-40e4-b438-71344b88a211"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:59:22.371405 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.371224    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-service-ca\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:59:22.371405 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.371222    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "915487b3-fb49-40e4-b438-71344b88a211" (UID: "915487b3-fb49-40e4-b438-71344b88a211"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:59:22.371405 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.371243    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-console-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:59:22.371405 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.371255    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-trusted-ca-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:59:22.372940 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.372913    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "915487b3-fb49-40e4-b438-71344b88a211" (UID: "915487b3-fb49-40e4-b438-71344b88a211"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:59:22.373063 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.372956    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "915487b3-fb49-40e4-b438-71344b88a211" (UID: "915487b3-fb49-40e4-b438-71344b88a211"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:59:22.373063 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.372962    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/915487b3-fb49-40e4-b438-71344b88a211-kube-api-access-9zql9" (OuterVolumeSpecName: "kube-api-access-9zql9") pod "915487b3-fb49-40e4-b438-71344b88a211" (UID: "915487b3-fb49-40e4-b438-71344b88a211"). InnerVolumeSpecName "kube-api-access-9zql9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:59:22.471684 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.471644    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:59:22.471684 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.471677    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/915487b3-fb49-40e4-b438-71344b88a211-console-oauth-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:59:22.471684 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.471687    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/915487b3-fb49-40e4-b438-71344b88a211-oauth-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:59:22.471684 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:22.471696    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zql9\" (UniqueName: \"kubernetes.io/projected/915487b3-fb49-40e4-b438-71344b88a211-kube-api-access-9zql9\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 06:59:23.096872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.096782    2573 generic.go:356] "Generic (PLEG): container finished" podID="915487b3-fb49-40e4-b438-71344b88a211" containerID="1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c" exitCode=0
Jul 08 06:59:23.096872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.096831    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f8dfc7b-5gm4g"
Jul 08 06:59:23.096872 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.096845    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f8dfc7b-5gm4g" event={"ID":"915487b3-fb49-40e4-b438-71344b88a211","Type":"ContainerDied","Data":"1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c"}
Jul 08 06:59:23.097335 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.096884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f8dfc7b-5gm4g" event={"ID":"915487b3-fb49-40e4-b438-71344b88a211","Type":"ContainerDied","Data":"46fee2ba3af128371255fe83116d1b1b87e1e50e7e6efc79417b4fafc1578d8e"}
Jul 08 06:59:23.097335 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.096903    2573 scope.go:117] "RemoveContainer" containerID="1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c"
Jul 08 06:59:23.104929 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.104908    2573 scope.go:117] "RemoveContainer" containerID="1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c"
Jul 08 06:59:23.105191 ip-10-0-136-129 kubenswrapper[2573]: E0708 06:59:23.105173    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c\": container with ID starting with 1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c not found: ID does not exist" containerID="1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c"
Jul 08 06:59:23.105240 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.105200    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c"} err="failed to get container status \"1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c\": rpc error: code = NotFound desc = could not find container \"1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c\": container with ID starting with 1a0c65932b26e259d33e243a0f223c32f167fde510efa5f9708eaa2b55a5cb4c not found: ID does not exist"
Jul 08 06:59:23.113055 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.113028    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658f8dfc7b-5gm4g"]
Jul 08 06:59:23.117296 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:23.117275    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-658f8dfc7b-5gm4g"]
Jul 08 06:59:24.820488 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:24.820450    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="915487b3-fb49-40e4-b438-71344b88a211" path="/var/lib/kubelet/pods/915487b3-fb49-40e4-b438-71344b88a211/volumes"
Jul 08 06:59:40.730701 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:40.730671    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 06:59:46.435454 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.435419    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"]
Jul 08 06:59:46.437722 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.435712    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="915487b3-fb49-40e4-b438-71344b88a211" containerName="console"
Jul 08 06:59:46.437722 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.435723    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="915487b3-fb49-40e4-b438-71344b88a211" containerName="console"
Jul 08 06:59:46.437722 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.435799    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="915487b3-fb49-40e4-b438-71344b88a211" containerName="console"
Jul 08 06:59:46.438668 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.438651    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.440968 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.440944    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 06:59:46.441089 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.440965    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 06:59:46.441089 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.440992    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lkxw9\""
Jul 08 06:59:46.446949 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.446926    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"]
Jul 08 06:59:46.579539 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.579498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.579539 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.579540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g86z\" (UniqueName: \"kubernetes.io/projected/e094d9b4-fff9-4260-a128-cc3d309b48c1-kube-api-access-8g86z\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.579791 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.579634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.680790 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.680746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.680944 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.680829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.680944 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.680853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g86z\" (UniqueName: \"kubernetes.io/projected/e094d9b4-fff9-4260-a128-cc3d309b48c1-kube-api-access-8g86z\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.681148 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.681119    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.681187 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.681143    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.689615 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.689565    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g86z\" (UniqueName: \"kubernetes.io/projected/e094d9b4-fff9-4260-a128-cc3d309b48c1-kube-api-access-8g86z\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.749167 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.749127    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 06:59:46.885084 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.885054    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"]
Jul 08 06:59:46.888860 ip-10-0-136-129 kubenswrapper[2573]: W0708 06:59:46.888832    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode094d9b4_fff9_4260_a128_cc3d309b48c1.slice/crio-e4c71315e74e0674f797624438c21a64957fcda42b941ff2def859935e316285 WatchSource:0}: Error finding container e4c71315e74e0674f797624438c21a64957fcda42b941ff2def859935e316285: Status 404 returned error can't find the container with id e4c71315e74e0674f797624438c21a64957fcda42b941ff2def859935e316285
Jul 08 06:59:46.890726 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:46.890710    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 06:59:47.188229 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:47.188191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt" event={"ID":"e094d9b4-fff9-4260-a128-cc3d309b48c1","Type":"ContainerStarted","Data":"e4c71315e74e0674f797624438c21a64957fcda42b941ff2def859935e316285"}
Jul 08 06:59:54.220502 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:54.220420    2573 generic.go:356] "Generic (PLEG): container finished" podID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerID="03bab9041dacbfa8806be75a33003a0ac7376fa7dd521df3de62e69804e3ab51" exitCode=0
Jul 08 06:59:54.220502 ip-10-0-136-129 kubenswrapper[2573]: I0708 06:59:54.220482    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt" event={"ID":"e094d9b4-fff9-4260-a128-cc3d309b48c1","Type":"ContainerDied","Data":"03bab9041dacbfa8806be75a33003a0ac7376fa7dd521df3de62e69804e3ab51"}
Jul 08 07:00:13.298334 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:13.298298    2573 generic.go:356] "Generic (PLEG): container finished" podID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerID="2c2382e0d60135b85ab49601b775e5cb82ede28f4208c53fc2524355092db50c" exitCode=0
Jul 08 07:00:13.298804 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:13.298388    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt" event={"ID":"e094d9b4-fff9-4260-a128-cc3d309b48c1","Type":"ContainerDied","Data":"2c2382e0d60135b85ab49601b775e5cb82ede28f4208c53fc2524355092db50c"}
Jul 08 07:00:22.339078 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:22.338987    2573 generic.go:356] "Generic (PLEG): container finished" podID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerID="5d8b85d4e566f7d07410e5ec3b560c660d16e4c0bd2f51d71e914eb115576290" exitCode=0
Jul 08 07:00:22.339078 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:22.339063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt" event={"ID":"e094d9b4-fff9-4260-a128-cc3d309b48c1","Type":"ContainerDied","Data":"5d8b85d4e566f7d07410e5ec3b560c660d16e4c0bd2f51d71e914eb115576290"}
Jul 08 07:00:23.467658 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.467632    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 07:00:23.587569 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.587531    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-util\") pod \"e094d9b4-fff9-4260-a128-cc3d309b48c1\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") "
Jul 08 07:00:23.587569 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.587575    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g86z\" (UniqueName: \"kubernetes.io/projected/e094d9b4-fff9-4260-a128-cc3d309b48c1-kube-api-access-8g86z\") pod \"e094d9b4-fff9-4260-a128-cc3d309b48c1\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") "
Jul 08 07:00:23.587804 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.587620    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-bundle\") pod \"e094d9b4-fff9-4260-a128-cc3d309b48c1\" (UID: \"e094d9b4-fff9-4260-a128-cc3d309b48c1\") "
Jul 08 07:00:23.588495 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.588461    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-bundle" (OuterVolumeSpecName: "bundle") pod "e094d9b4-fff9-4260-a128-cc3d309b48c1" (UID: "e094d9b4-fff9-4260-a128-cc3d309b48c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:00:23.589872 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.589847    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e094d9b4-fff9-4260-a128-cc3d309b48c1-kube-api-access-8g86z" (OuterVolumeSpecName: "kube-api-access-8g86z") pod "e094d9b4-fff9-4260-a128-cc3d309b48c1" (UID: "e094d9b4-fff9-4260-a128-cc3d309b48c1"). InnerVolumeSpecName "kube-api-access-8g86z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:00:23.591981 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.591961    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-util" (OuterVolumeSpecName: "util") pod "e094d9b4-fff9-4260-a128-cc3d309b48c1" (UID: "e094d9b4-fff9-4260-a128-cc3d309b48c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:00:23.688525 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.688487    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-util\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:00:23.688525 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.688518    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g86z\" (UniqueName: \"kubernetes.io/projected/e094d9b4-fff9-4260-a128-cc3d309b48c1-kube-api-access-8g86z\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:00:23.688525 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:23.688530    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e094d9b4-fff9-4260-a128-cc3d309b48c1-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:00:24.349318 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:24.349290    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt"
Jul 08 07:00:24.349521 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:24.349283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589pmsvt" event={"ID":"e094d9b4-fff9-4260-a128-cc3d309b48c1","Type":"ContainerDied","Data":"e4c71315e74e0674f797624438c21a64957fcda42b941ff2def859935e316285"}
Jul 08 07:00:24.349521 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:24.349412    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4c71315e74e0674f797624438c21a64957fcda42b941ff2def859935e316285"
Jul 08 07:00:30.172107 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172070    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"]
Jul 08 07:00:30.172479 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172371    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerName="extract"
Jul 08 07:00:30.172479 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172383    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerName="extract"
Jul 08 07:00:30.172479 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172402    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerName="util"
Jul 08 07:00:30.172479 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172409    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerName="util"
Jul 08 07:00:30.172479 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172419    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerName="pull"
Jul 08 07:00:30.172479 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172424    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerName="pull"
Jul 08 07:00:30.172479 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.172473    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e094d9b4-fff9-4260-a128-cc3d309b48c1" containerName="extract"
Jul 08 07:00:30.174973 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.174956    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.177695 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.177678    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 08 07:00:30.177949 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.177934    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 08 07:00:30.178077 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.178056    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-zsg82\""
Jul 08 07:00:30.178130 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.178118    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 08 07:00:30.192140 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.192112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"]
Jul 08 07:00:30.250248 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.250207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d938a804-5dbe-4230-aca6-957f72877a73-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4\" (UID: \"d938a804-5dbe-4230-aca6-957f72877a73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.250426 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.250319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-584x4\" (UniqueName: \"kubernetes.io/projected/d938a804-5dbe-4230-aca6-957f72877a73-kube-api-access-584x4\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4\" (UID: \"d938a804-5dbe-4230-aca6-957f72877a73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.351080 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.351041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-584x4\" (UniqueName: \"kubernetes.io/projected/d938a804-5dbe-4230-aca6-957f72877a73-kube-api-access-584x4\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4\" (UID: \"d938a804-5dbe-4230-aca6-957f72877a73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.351249 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.351096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d938a804-5dbe-4230-aca6-957f72877a73-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4\" (UID: \"d938a804-5dbe-4230-aca6-957f72877a73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.353360 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.353329    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d938a804-5dbe-4230-aca6-957f72877a73-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4\" (UID: \"d938a804-5dbe-4230-aca6-957f72877a73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.363305 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.363268    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-584x4\" (UniqueName: \"kubernetes.io/projected/d938a804-5dbe-4230-aca6-957f72877a73-kube-api-access-584x4\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4\" (UID: \"d938a804-5dbe-4230-aca6-957f72877a73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.484673 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.484575    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:30.652226 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:30.652199    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"]
Jul 08 07:00:30.654371 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:00:30.654346    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd938a804_5dbe_4230_aca6_957f72877a73.slice/crio-40e4fc3f225d249996c7a759eb5c9f52e0a03ef96eba577cbf1b1bf464d45d07 WatchSource:0}: Error finding container 40e4fc3f225d249996c7a759eb5c9f52e0a03ef96eba577cbf1b1bf464d45d07: Status 404 returned error can't find the container with id 40e4fc3f225d249996c7a759eb5c9f52e0a03ef96eba577cbf1b1bf464d45d07
Jul 08 07:00:31.377233 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:31.377197    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4" event={"ID":"d938a804-5dbe-4230-aca6-957f72877a73","Type":"ContainerStarted","Data":"40e4fc3f225d249996c7a759eb5c9f52e0a03ef96eba577cbf1b1bf464d45d07"}
Jul 08 07:00:35.091292 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.091260    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-55xd8"]
Jul 08 07:00:35.094629 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.094608    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.097727 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:35.097693    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"keda-operator-68bff59c-55xd8\" is forbidden: User \"system:node:ip-10-0-136-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-136-129.ec2.internal' and this object" podUID="41f22d1b-4073-4a54-9f48-ccbc38f98ef7" pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.097727 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:35.097699    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"keda-operator-certs\" is forbidden: User \"system:node:ip-10-0-136-129.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-136-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" type="*v1.Secret"
Jul 08 07:00:35.098032 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:35.098008    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"keda-operator-dockercfg-vhhbg\" is forbidden: User \"system:node:ip-10-0-136-129.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-136-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-vhhbg\"" type="*v1.Secret"
Jul 08 07:00:35.098102 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:35.098052    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"keda-ocp-cabundle\" is forbidden: User \"system:node:ip-10-0-136-129.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-136-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" type="*v1.ConfigMap"
Jul 08 07:00:35.111385 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.111361    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-55xd8"]
Jul 08 07:00:35.192427 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.192388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-cabundle0\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.192595 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.192468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrgkv\" (UniqueName: \"kubernetes.io/projected/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-kube-api-access-jrgkv\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.192595 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.192490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-certificates\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.293861 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.293826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-cabundle0\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.294040 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.293923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrgkv\" (UniqueName: \"kubernetes.io/projected/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-kube-api-access-jrgkv\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.294040 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.293952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-certificates\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.304513 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.304475    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrgkv\" (UniqueName: \"kubernetes.io/projected/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-kube-api-access-jrgkv\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:35.398952 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.398864    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"]
Jul 08 07:00:35.402236 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.402214    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:00:35.402354 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.402244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4" event={"ID":"d938a804-5dbe-4230-aca6-957f72877a73","Type":"ContainerStarted","Data":"7d6f99f84612533b527a0aebb42bf83de5b62eec8e15e07f1b221484c34bf8b8"}
Jul 08 07:00:35.402354 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.402322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.405490 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.405469    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 08 07:00:35.420549 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.420519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"]
Jul 08 07:00:35.452427 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.452373    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4" podStartSLOduration=1.778713373 podStartE2EDuration="5.452358527s" totalImagesPullingTime="3.673645154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:00:35.450529392 +0000 UTC m=+355.146050273" watchObservedRunningTime="2026-07-08 07:00:35.452358527 +0000 UTC m=+355.147879406"
Jul 08 07:00:35.494756 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.494723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-certificates\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.494946 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.494821    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8668a487-dcff-4d66-8570-a1f3dac3071c-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.494946 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.494850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqkf4\" (UniqueName: \"kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-kube-api-access-zqkf4\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.595912 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.595873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqkf4\" (UniqueName: \"kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-kube-api-access-zqkf4\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.596062 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.596017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-certificates\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.596121 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.596078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8668a487-dcff-4d66-8570-a1f3dac3071c-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.596164 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:35.596145    2573 secret.go:281] references non-existent secret key: tls.crt
Jul 08 07:00:35.596199 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:35.596167    2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 08 07:00:35.596399 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.596385    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8668a487-dcff-4d66-8570-a1f3dac3071c-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.606850 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.606827    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqkf4\" (UniqueName: \"kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-kube-api-access-zqkf4\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:35.902499 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.902461    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vktrf"]
Jul 08 07:00:35.905932 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.905908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:35.908484 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.908461    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 08 07:00:35.919501 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.919472    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vktrf"]
Jul 08 07:00:35.999721 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.999689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/827dc363-220e-4422-8248-95d91e0676a6-certificates\") pod \"keda-admission-5fbd5c4644-vktrf\" (UID: \"827dc363-220e-4422-8248-95d91e0676a6\") " pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:35.999924 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:35.999746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lmgs\" (UniqueName: \"kubernetes.io/projected/827dc363-220e-4422-8248-95d91e0676a6-kube-api-access-9lmgs\") pod \"keda-admission-5fbd5c4644-vktrf\" (UID: \"827dc363-220e-4422-8248-95d91e0676a6\") " pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:36.035087 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.035057    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 08 07:00:36.037075 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:36.037056    2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6: references non-existent secret key: tls.crt
Jul 08 07:00:36.037138 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:00:36.037128    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-certificates podName:8668a487-dcff-4d66-8570-a1f3dac3071c nodeName:}" failed. No retries permitted until 2026-07-08 07:00:36.537108015 +0000 UTC m=+356.232628891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-certificates") pod "keda-metrics-apiserver-559f75f947-lqxf6" (UID: "8668a487-dcff-4d66-8570-a1f3dac3071c") : references non-existent secret key: tls.crt
Jul 08 07:00:36.044909 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.044886    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-cabundle0\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:36.100572 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.100536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lmgs\" (UniqueName: \"kubernetes.io/projected/827dc363-220e-4422-8248-95d91e0676a6-kube-api-access-9lmgs\") pod \"keda-admission-5fbd5c4644-vktrf\" (UID: \"827dc363-220e-4422-8248-95d91e0676a6\") " pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:36.100972 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.100645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/827dc363-220e-4422-8248-95d91e0676a6-certificates\") pod \"keda-admission-5fbd5c4644-vktrf\" (UID: \"827dc363-220e-4422-8248-95d91e0676a6\") " pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:36.103181 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.103150    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/827dc363-220e-4422-8248-95d91e0676a6-certificates\") pod \"keda-admission-5fbd5c4644-vktrf\" (UID: \"827dc363-220e-4422-8248-95d91e0676a6\") " pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:36.113079 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.113051    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lmgs\" (UniqueName: \"kubernetes.io/projected/827dc363-220e-4422-8248-95d91e0676a6-kube-api-access-9lmgs\") pod \"keda-admission-5fbd5c4644-vktrf\" (UID: \"827dc363-220e-4422-8248-95d91e0676a6\") " pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:36.172798 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.172692    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 08 07:00:36.177037 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.177011    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/41f22d1b-4073-4a54-9f48-ccbc38f98ef7-certificates\") pod \"keda-operator-68bff59c-55xd8\" (UID: \"41f22d1b-4073-4a54-9f48-ccbc38f98ef7\") " pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:36.605029 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.604990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-certificates\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:36.607935 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.607913    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8668a487-dcff-4d66-8570-a1f3dac3071c-certificates\") pod \"keda-metrics-apiserver-559f75f947-lqxf6\" (UID: \"8668a487-dcff-4d66-8570-a1f3dac3071c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:36.685192 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.685161    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-vhhbg\""
Jul 08 07:00:36.686847 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.686815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:36.692923 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.692900    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:36.694142 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.694118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:36.886857 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.886593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"]
Jul 08 07:00:36.889920 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:00:36.889891    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8668a487_dcff_4d66_8570_a1f3dac3071c.slice/crio-aaa918252f6cac79b3054c81efafa025fd12de76b736cf8a58f284e173ecad9a WatchSource:0}: Error finding container aaa918252f6cac79b3054c81efafa025fd12de76b736cf8a58f284e173ecad9a: Status 404 returned error can't find the container with id aaa918252f6cac79b3054c81efafa025fd12de76b736cf8a58f284e173ecad9a
Jul 08 07:00:36.905399 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.905377    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vktrf"]
Jul 08 07:00:36.907508 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:00:36.907481    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827dc363_220e_4422_8248_95d91e0676a6.slice/crio-afc87af6b8800140d3b3d7c5602b961057e46c7bde52c336cdb5689bd94f9ce8 WatchSource:0}: Error finding container afc87af6b8800140d3b3d7c5602b961057e46c7bde52c336cdb5689bd94f9ce8: Status 404 returned error can't find the container with id afc87af6b8800140d3b3d7c5602b961057e46c7bde52c336cdb5689bd94f9ce8
Jul 08 07:00:36.909240 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:36.909222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-55xd8"]
Jul 08 07:00:36.911655 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:00:36.911632    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f22d1b_4073_4a54_9f48_ccbc38f98ef7.slice/crio-0ee1c4eed35414d439f1e1db08b610f1a369f7485ccd539b8d53f99d8aac11b2 WatchSource:0}: Error finding container 0ee1c4eed35414d439f1e1db08b610f1a369f7485ccd539b8d53f99d8aac11b2: Status 404 returned error can't find the container with id 0ee1c4eed35414d439f1e1db08b610f1a369f7485ccd539b8d53f99d8aac11b2
Jul 08 07:00:37.409026 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:37.408984    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-vktrf" event={"ID":"827dc363-220e-4422-8248-95d91e0676a6","Type":"ContainerStarted","Data":"afc87af6b8800140d3b3d7c5602b961057e46c7bde52c336cdb5689bd94f9ce8"}
Jul 08 07:00:37.410133 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:37.410112    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6" event={"ID":"8668a487-dcff-4d66-8570-a1f3dac3071c","Type":"ContainerStarted","Data":"aaa918252f6cac79b3054c81efafa025fd12de76b736cf8a58f284e173ecad9a"}
Jul 08 07:00:37.416502 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:37.411622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-55xd8" event={"ID":"41f22d1b-4073-4a54-9f48-ccbc38f98ef7","Type":"ContainerStarted","Data":"0ee1c4eed35414d439f1e1db08b610f1a369f7485ccd539b8d53f99d8aac11b2"}
Jul 08 07:00:39.423647 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:39.423606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-vktrf" event={"ID":"827dc363-220e-4422-8248-95d91e0676a6","Type":"ContainerStarted","Data":"28caba43608574ba3fb011bb03900113032a43f51e9c3203c98a70d4c83c4a67"}
Jul 08 07:00:39.424098 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:39.423748    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:00:39.444246 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:39.444188    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-vktrf" podStartSLOduration=2.594565847 podStartE2EDuration="4.444167219s" totalImagesPullingTime="1.849601372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:00:39.442791781 +0000 UTC m=+359.138312659" watchObservedRunningTime="2026-07-08 07:00:39.444167219 +0000 UTC m=+359.139688101"
Jul 08 07:00:41.434086 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:41.434041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-55xd8" event={"ID":"41f22d1b-4073-4a54-9f48-ccbc38f98ef7","Type":"ContainerStarted","Data":"df9f215eec7e1fea8b3677bcf01657ca5c5bddcfd85b6b8cec1345f98a4eb238"}
Jul 08 07:00:41.434527 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:41.434113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:00:41.435523 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:41.435499    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6" event={"ID":"8668a487-dcff-4d66-8570-a1f3dac3071c","Type":"ContainerStarted","Data":"c0306292d466d728967aa374b8e6d03295ab51f4a49cc74d702d1d0cc7c632ee"}
Jul 08 07:00:41.435647 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:41.435632    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:41.451119 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:41.451074    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-55xd8" podStartSLOduration=2.467613314 podStartE2EDuration="6.451059279s" totalImagesPullingTime="3.983445965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:00:41.45003905 +0000 UTC m=+361.145559932" watchObservedRunningTime="2026-07-08 07:00:41.451059279 +0000 UTC m=+361.146580160"
Jul 08 07:00:41.466851 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:41.466798    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6" podStartSLOduration=2.466965549 podStartE2EDuration="6.466778516s" totalImagesPullingTime="3.999812967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:00:41.466078487 +0000 UTC m=+361.161599369" watchObservedRunningTime="2026-07-08 07:00:41.466778516 +0000 UTC m=+361.162299396"
Jul 08 07:00:52.445335 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:52.445304    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-lqxf6"
Jul 08 07:00:56.406687 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:00:56.406659    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dpwj4"
Jul 08 07:01:00.431167 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:00.431134    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-vktrf"
Jul 08 07:01:02.443158 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:02.443128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-55xd8"
Jul 08 07:01:41.481728 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.481691    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"]
Jul 08 07:01:41.485024 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.485008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:41.487899 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.487866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 08 07:01:41.488033 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.487916    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 08 07:01:41.488033 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.487974    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-ltcjx\""
Jul 08 07:01:41.489078 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.489058    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 08 07:01:41.493942 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.493921    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"]
Jul 08 07:01:41.568410 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.568372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert\") pod \"llmisvc-controller-manager-7f5b66ddfc-7vmfm\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") " pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:41.568575 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.568448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl5pc\" (UniqueName: \"kubernetes.io/projected/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-kube-api-access-fl5pc\") pod \"llmisvc-controller-manager-7f5b66ddfc-7vmfm\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") " pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:41.668835 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.668803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert\") pod \"llmisvc-controller-manager-7f5b66ddfc-7vmfm\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") " pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:41.669000 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.668872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl5pc\" (UniqueName: \"kubernetes.io/projected/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-kube-api-access-fl5pc\") pod \"llmisvc-controller-manager-7f5b66ddfc-7vmfm\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") " pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:41.669000 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:01:41.668952    2573 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 07:01:41.669069 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:01:41.669023    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert podName:b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1 nodeName:}" failed. No retries permitted until 2026-07-08 07:01:42.169006816 +0000 UTC m=+421.864527678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert") pod "llmisvc-controller-manager-7f5b66ddfc-7vmfm" (UID: "b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1") : secret "llmisvc-webhook-server-cert" not found
Jul 08 07:01:41.678085 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:41.678058    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl5pc\" (UniqueName: \"kubernetes.io/projected/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-kube-api-access-fl5pc\") pod \"llmisvc-controller-manager-7f5b66ddfc-7vmfm\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") " pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:42.172679 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:42.172641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert\") pod \"llmisvc-controller-manager-7f5b66ddfc-7vmfm\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") " pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:42.175138 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:42.175110    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert\") pod \"llmisvc-controller-manager-7f5b66ddfc-7vmfm\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") " pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:42.395741 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:42.395689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:42.523915 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:42.523891    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"]
Jul 08 07:01:42.705592 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:42.705511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm" event={"ID":"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1","Type":"ContainerStarted","Data":"488028788ec32be95ac51dc1b4ee669154fe472e43bddd414793dc0af16029e7"}
Jul 08 07:01:46.726780 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:46.726732    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm" event={"ID":"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1","Type":"ContainerStarted","Data":"20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36"}
Jul 08 07:01:46.727144 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:46.726817    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:01:46.743043 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:01:46.742983    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm" podStartSLOduration=2.428157135 podStartE2EDuration="5.7429647s" totalImagesPullingTime="3.314807565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:01:46.741680348 +0000 UTC m=+426.437201227" watchObservedRunningTime="2026-07-08 07:01:46.7429647 +0000 UTC m=+426.438485581"
Jul 08 07:02:17.733210 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:17.733130    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 07:02:19.254124 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.254085    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"]
Jul 08 07:02:19.259181 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.259162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.261657 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.261624    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 07:02:19.261791 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.261740    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 07:02:19.262463 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.262447    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lkxw9\""
Jul 08 07:02:19.266706 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.266600    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"]
Jul 08 07:02:19.397700 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.397606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.397700 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.397645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbs6d\" (UniqueName: \"kubernetes.io/projected/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-kube-api-access-xbs6d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.397970 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.397752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.498621 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.498585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.498621 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.498624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbs6d\" (UniqueName: \"kubernetes.io/projected/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-kube-api-access-xbs6d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.498846 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.498662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.499023 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.499001    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.499066 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.499049    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.509949 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.509919    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbs6d\" (UniqueName: \"kubernetes.io/projected/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-kube-api-access-xbs6d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.570109 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.570074    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:19.700442 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.700420    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"]
Jul 08 07:02:19.702561 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:02:19.702532    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b4120b_d470_4a94_ac6a_8ecbcd8cbfb5.slice/crio-9fbe15b9f540a836e36ac5c9aea1785d9f8afeb32a132357ebc6db7154cd7811 WatchSource:0}: Error finding container 9fbe15b9f540a836e36ac5c9aea1785d9f8afeb32a132357ebc6db7154cd7811: Status 404 returned error can't find the container with id 9fbe15b9f540a836e36ac5c9aea1785d9f8afeb32a132357ebc6db7154cd7811
Jul 08 07:02:19.871593 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.871557    2573 generic.go:356] "Generic (PLEG): container finished" podID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerID="570d0baeba4b0cb8874030f586d1c86dcf586c597eba64c5de68f7e0cccb32be" exitCode=0
Jul 08 07:02:19.871799 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.871630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr" event={"ID":"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5","Type":"ContainerDied","Data":"570d0baeba4b0cb8874030f586d1c86dcf586c597eba64c5de68f7e0cccb32be"}
Jul 08 07:02:19.871799 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:19.871679    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr" event={"ID":"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5","Type":"ContainerStarted","Data":"9fbe15b9f540a836e36ac5c9aea1785d9f8afeb32a132357ebc6db7154cd7811"}
Jul 08 07:02:22.887808 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:22.887748    2573 generic.go:356] "Generic (PLEG): container finished" podID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerID="d66a73e96c421b5586ae1f878bbf76d1614a7216aa8998ec227e858941a033fe" exitCode=0
Jul 08 07:02:22.888182 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:22.887836    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr" event={"ID":"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5","Type":"ContainerDied","Data":"d66a73e96c421b5586ae1f878bbf76d1614a7216aa8998ec227e858941a033fe"}
Jul 08 07:02:23.894105 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:23.894075    2573 generic.go:356] "Generic (PLEG): container finished" podID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerID="0b25458633057e1da0f8291821baceef000e941d17457635340bf538b3d5aa6a" exitCode=0
Jul 08 07:02:23.894481 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:23.894167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr" event={"ID":"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5","Type":"ContainerDied","Data":"0b25458633057e1da0f8291821baceef000e941d17457635340bf538b3d5aa6a"}
Jul 08 07:02:25.024646 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.024615    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:25.151255 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.151171    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbs6d\" (UniqueName: \"kubernetes.io/projected/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-kube-api-access-xbs6d\") pod \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") "
Jul 08 07:02:25.151255 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.151215    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-bundle\") pod \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") "
Jul 08 07:02:25.151255 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.151252    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-util\") pod \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\" (UID: \"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5\") "
Jul 08 07:02:25.151924 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.151897    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-bundle" (OuterVolumeSpecName: "bundle") pod "13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" (UID: "13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:02:25.153207 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.153178    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-kube-api-access-xbs6d" (OuterVolumeSpecName: "kube-api-access-xbs6d") pod "13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" (UID: "13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5"). InnerVolumeSpecName "kube-api-access-xbs6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:02:25.155923 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.155900    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-util" (OuterVolumeSpecName: "util") pod "13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" (UID: "13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:02:25.252269 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.252233    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-util\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:02:25.252269 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.252262    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbs6d\" (UniqueName: \"kubernetes.io/projected/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-kube-api-access-xbs6d\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:02:25.252269 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.252272    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:02:25.905014 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.904980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr" event={"ID":"13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5","Type":"ContainerDied","Data":"9fbe15b9f540a836e36ac5c9aea1785d9f8afeb32a132357ebc6db7154cd7811"}
Jul 08 07:02:25.905203 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.905024    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fbe15b9f540a836e36ac5c9aea1785d9f8afeb32a132357ebc6db7154cd7811"
Jul 08 07:02:25.905203 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:25.905028    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408vjfr"
Jul 08 07:02:41.403427 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403394    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"]
Jul 08 07:02:41.403870 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403722    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerName="pull"
Jul 08 07:02:41.403870 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403732    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerName="pull"
Jul 08 07:02:41.403870 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403746    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerName="util"
Jul 08 07:02:41.403870 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403751    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerName="util"
Jul 08 07:02:41.403870 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403783    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerName="extract"
Jul 08 07:02:41.403870 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403792    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerName="extract"
Jul 08 07:02:41.403870 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.403868    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="13b4120b-d470-4a94-ac6a-8ecbcd8cbfb5" containerName="extract"
Jul 08 07:02:41.410180 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.410158    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.412784 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.412738    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lkxw9\""
Jul 08 07:02:41.412895 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.412791    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 07:02:41.413679 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.413659    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 07:02:41.419380 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.419360    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"]
Jul 08 07:02:41.484262 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.484229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.484262 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.484276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.484492 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.484321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqptj\" (UniqueName: \"kubernetes.io/projected/9c5175d8-8319-4dce-9b82-d28e8ec64515-kube-api-access-rqptj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.584950 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.584909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.585222 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.584974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqptj\" (UniqueName: \"kubernetes.io/projected/9c5175d8-8319-4dce-9b82-d28e8ec64515-kube-api-access-rqptj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.585222 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.585040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.585355 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.585330    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.585448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.585427    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.593225 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.593189    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqptj\" (UniqueName: \"kubernetes.io/projected/9c5175d8-8319-4dce-9b82-d28e8ec64515-kube-api-access-rqptj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.719164 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.719080    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:41.847612 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.847589    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"]
Jul 08 07:02:41.849630 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:02:41.849605    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5175d8_8319_4dce_9b82_d28e8ec64515.slice/crio-019682333d87fd88b37ada821dfac6ea7c5408e0124d9f27113ddb2423c0525c WatchSource:0}: Error finding container 019682333d87fd88b37ada821dfac6ea7c5408e0124d9f27113ddb2423c0525c: Status 404 returned error can't find the container with id 019682333d87fd88b37ada821dfac6ea7c5408e0124d9f27113ddb2423c0525c
Jul 08 07:02:41.976852 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.976758    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerID="7fc144ad9532a864690072b5eb7b2e15b9051378e91e27f14945adb69e8bb718" exitCode=0
Jul 08 07:02:41.976852 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.976789    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh" event={"ID":"9c5175d8-8319-4dce-9b82-d28e8ec64515","Type":"ContainerDied","Data":"7fc144ad9532a864690072b5eb7b2e15b9051378e91e27f14945adb69e8bb718"}
Jul 08 07:02:41.977010 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:41.976865    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh" event={"ID":"9c5175d8-8319-4dce-9b82-d28e8ec64515","Type":"ContainerStarted","Data":"019682333d87fd88b37ada821dfac6ea7c5408e0124d9f27113ddb2423c0525c"}
Jul 08 07:02:43.988481 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:43.988448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh" event={"ID":"9c5175d8-8319-4dce-9b82-d28e8ec64515","Type":"ContainerStarted","Data":"9d89b444e9b47bedb3e850ce507e6e0e4da58175df6e7547bac21e391670b97b"}
Jul 08 07:02:44.994859 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:44.994826    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerID="9d89b444e9b47bedb3e850ce507e6e0e4da58175df6e7547bac21e391670b97b" exitCode=0
Jul 08 07:02:44.995228 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:44.994902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh" event={"ID":"9c5175d8-8319-4dce-9b82-d28e8ec64515","Type":"ContainerDied","Data":"9d89b444e9b47bedb3e850ce507e6e0e4da58175df6e7547bac21e391670b97b"}
Jul 08 07:02:46.000880 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:46.000843    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerID="87a58911e449895684895f188fc3b0680dece1a5750cdb14addf8974d2768de9" exitCode=0
Jul 08 07:02:46.001272 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:46.000928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh" event={"ID":"9c5175d8-8319-4dce-9b82-d28e8ec64515","Type":"ContainerDied","Data":"87a58911e449895684895f188fc3b0680dece1a5750cdb14addf8974d2768de9"}
Jul 08 07:02:47.138367 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.138340    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:47.234139 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.234103    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-util\") pod \"9c5175d8-8319-4dce-9b82-d28e8ec64515\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") "
Jul 08 07:02:47.234298 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.234166    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqptj\" (UniqueName: \"kubernetes.io/projected/9c5175d8-8319-4dce-9b82-d28e8ec64515-kube-api-access-rqptj\") pod \"9c5175d8-8319-4dce-9b82-d28e8ec64515\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") "
Jul 08 07:02:47.234298 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.234207    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-bundle\") pod \"9c5175d8-8319-4dce-9b82-d28e8ec64515\" (UID: \"9c5175d8-8319-4dce-9b82-d28e8ec64515\") "
Jul 08 07:02:47.234598 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.234565    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-bundle" (OuterVolumeSpecName: "bundle") pod "9c5175d8-8319-4dce-9b82-d28e8ec64515" (UID: "9c5175d8-8319-4dce-9b82-d28e8ec64515"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:02:47.236262 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.236243    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c5175d8-8319-4dce-9b82-d28e8ec64515-kube-api-access-rqptj" (OuterVolumeSpecName: "kube-api-access-rqptj") pod "9c5175d8-8319-4dce-9b82-d28e8ec64515" (UID: "9c5175d8-8319-4dce-9b82-d28e8ec64515"). InnerVolumeSpecName "kube-api-access-rqptj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:02:47.239956 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.239933    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-util" (OuterVolumeSpecName: "util") pod "9c5175d8-8319-4dce-9b82-d28e8ec64515" (UID: "9c5175d8-8319-4dce-9b82-d28e8ec64515"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:02:47.335015 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.334932    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-util\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:02:47.335015 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.334960    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqptj\" (UniqueName: \"kubernetes.io/projected/9c5175d8-8319-4dce-9b82-d28e8ec64515-kube-api-access-rqptj\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:02:47.335015 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:47.334969    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c5175d8-8319-4dce-9b82-d28e8ec64515-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:02:48.011585 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:48.011546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh" event={"ID":"9c5175d8-8319-4dce-9b82-d28e8ec64515","Type":"ContainerDied","Data":"019682333d87fd88b37ada821dfac6ea7c5408e0124d9f27113ddb2423c0525c"}
Jul 08 07:02:48.011585 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:48.011587    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdtjgh"
Jul 08 07:02:48.011838 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:48.011605    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="019682333d87fd88b37ada821dfac6ea7c5408e0124d9f27113ddb2423c0525c"
Jul 08 07:02:52.105049 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:02:52.105018    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f66b95d4-wbctg"]
Jul 08 07:03:08.832424 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.832390    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"]
Jul 08 07:03:08.832903 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.832879    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerName="util"
Jul 08 07:03:08.832903 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.832897    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerName="util"
Jul 08 07:03:08.833018 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.832917    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerName="extract"
Jul 08 07:03:08.833018 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.832925    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerName="extract"
Jul 08 07:03:08.833018 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.832943    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerName="pull"
Jul 08 07:03:08.833018 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.832951    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerName="pull"
Jul 08 07:03:08.833206 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.833054    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5175d8-8319-4dce-9b82-d28e8ec64515" containerName="extract"
Jul 08 07:03:08.836056 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.836036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:08.838442 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.838420    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 07:03:08.838588 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.838424    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 07:03:08.838895 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.838874    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 07:03:08.839034 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.838876    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 07:03:08.839122 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.839108    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9q8bj\""
Jul 08 07:03:08.847504 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.847482    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"]
Jul 08 07:03:08.918711 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.918673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:08.918897 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.918719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:08.918897 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.918809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:08.918897 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.918825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jnt\" (UniqueName: \"kubernetes.io/projected/5c16d266-24a7-4ee1-8619-4482c84755d7-kube-api-access-s4jnt\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:08.918897 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.918857    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:08.918897 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.918883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:08.919064 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:08.918923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c16d266-24a7-4ee1-8619-4482c84755d7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.019715 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.019664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c16d266-24a7-4ee1-8619-4482c84755d7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.019865 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.019728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.019865 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.019785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.019865 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.019839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.019987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.019864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jnt\" (UniqueName: \"kubernetes.io/projected/5c16d266-24a7-4ee1-8619-4482c84755d7-kube-api-access-s4jnt\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.019987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.019899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.019987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.019927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.020475 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.020446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.022238 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.022213    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.022355 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.022254    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c16d266-24a7-4ee1-8619-4482c84755d7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.022355 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.022277    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.022467 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.022366    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.027930 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.027907    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c16d266-24a7-4ee1-8619-4482c84755d7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.028256 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.028232    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jnt\" (UniqueName: \"kubernetes.io/projected/5c16d266-24a7-4ee1-8619-4482c84755d7-kube-api-access-s4jnt\") pod \"istiod-openshift-gateway-94bb8fbfd-596f9\" (UID: \"5c16d266-24a7-4ee1-8619-4482c84755d7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.145994 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.145907    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:09.287149 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:09.287120    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"]
Jul 08 07:03:09.289351 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:03:09.289325    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c16d266_24a7_4ee1_8619_4482c84755d7.slice/crio-5a3a2364c6ffe811ed4fafd47a9de4103a50ea0c6193f4b2e0daa4bae2276737 WatchSource:0}: Error finding container 5a3a2364c6ffe811ed4fafd47a9de4103a50ea0c6193f4b2e0daa4bae2276737: Status 404 returned error can't find the container with id 5a3a2364c6ffe811ed4fafd47a9de4103a50ea0c6193f4b2e0daa4bae2276737
Jul 08 07:03:10.112563 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:10.112523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9" event={"ID":"5c16d266-24a7-4ee1-8619-4482c84755d7","Type":"ContainerStarted","Data":"5a3a2364c6ffe811ed4fafd47a9de4103a50ea0c6193f4b2e0daa4bae2276737"}
Jul 08 07:03:11.494398 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:11.494350    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 07:03:11.494723 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:11.494452    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 07:03:12.124257 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:12.124223    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9" event={"ID":"5c16d266-24a7-4ee1-8619-4482c84755d7","Type":"ContainerStarted","Data":"e51d0f206ce9738caf9ecdba23afa8206068f170eac93bf1ce729553c3d5b269"}
Jul 08 07:03:12.124455 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:12.124438    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:12.126427 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:12.126389    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-596f9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 07:03:12.126554 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:12.126455    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9" podUID="5c16d266-24a7-4ee1-8619-4482c84755d7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 07:03:12.144999 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:12.144947    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9" podStartSLOduration=1.942411785 podStartE2EDuration="4.144931747s" totalImagesPullingTime="2.202519962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:03:12.14284493 +0000 UTC m=+511.838365811" watchObservedRunningTime="2026-07-08 07:03:12.144931747 +0000 UTC m=+511.840452627"
Jul 08 07:03:13.128994 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:13.128968    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-596f9"
Jul 08 07:03:17.126569 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.126529    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85f66b95d4-wbctg" podUID="824707dd-686f-4622-986a-70f0a3aac092" containerName="console" containerID="cri-o://5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079" gracePeriod=15
Jul 08 07:03:17.371685 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.371661    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 07:03:17.490958 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.490927    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-console-config\") pod \"824707dd-686f-4622-986a-70f0a3aac092\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") "
Jul 08 07:03:17.491098 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.490983    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-trusted-ca-bundle\") pod \"824707dd-686f-4622-986a-70f0a3aac092\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") "
Jul 08 07:03:17.491098 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491011    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-serving-cert\") pod \"824707dd-686f-4622-986a-70f0a3aac092\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") "
Jul 08 07:03:17.491098 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491049    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-oauth-config\") pod \"824707dd-686f-4622-986a-70f0a3aac092\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") "
Jul 08 07:03:17.491098 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491072    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-oauth-serving-cert\") pod \"824707dd-686f-4622-986a-70f0a3aac092\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") "
Jul 08 07:03:17.491098 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491092    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-service-ca\") pod \"824707dd-686f-4622-986a-70f0a3aac092\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") "
Jul 08 07:03:17.491357 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491192    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz9sc\" (UniqueName: \"kubernetes.io/projected/824707dd-686f-4622-986a-70f0a3aac092-kube-api-access-nz9sc\") pod \"824707dd-686f-4622-986a-70f0a3aac092\" (UID: \"824707dd-686f-4622-986a-70f0a3aac092\") "
Jul 08 07:03:17.491530 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491509    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-console-config" (OuterVolumeSpecName: "console-config") pod "824707dd-686f-4622-986a-70f0a3aac092" (UID: "824707dd-686f-4622-986a-70f0a3aac092"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:03:17.491702 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491677    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "824707dd-686f-4622-986a-70f0a3aac092" (UID: "824707dd-686f-4622-986a-70f0a3aac092"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:03:17.491788 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491734    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-service-ca" (OuterVolumeSpecName: "service-ca") pod "824707dd-686f-4622-986a-70f0a3aac092" (UID: "824707dd-686f-4622-986a-70f0a3aac092"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:03:17.491788 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.491740    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "824707dd-686f-4622-986a-70f0a3aac092" (UID: "824707dd-686f-4622-986a-70f0a3aac092"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:03:17.493430 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.493404    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824707dd-686f-4622-986a-70f0a3aac092-kube-api-access-nz9sc" (OuterVolumeSpecName: "kube-api-access-nz9sc") pod "824707dd-686f-4622-986a-70f0a3aac092" (UID: "824707dd-686f-4622-986a-70f0a3aac092"). InnerVolumeSpecName "kube-api-access-nz9sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:03:17.493430 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.493420    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "824707dd-686f-4622-986a-70f0a3aac092" (UID: "824707dd-686f-4622-986a-70f0a3aac092"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:03:17.493583 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.493442    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "824707dd-686f-4622-986a-70f0a3aac092" (UID: "824707dd-686f-4622-986a-70f0a3aac092"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:03:17.591889 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.591851    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-oauth-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:17.591889 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.591881    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-service-ca\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:17.591889 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.591891    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz9sc\" (UniqueName: \"kubernetes.io/projected/824707dd-686f-4622-986a-70f0a3aac092-kube-api-access-nz9sc\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:17.591889 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.591901    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-console-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:17.592166 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.591910    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824707dd-686f-4622-986a-70f0a3aac092-trusted-ca-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:17.592166 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.591918    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-serving-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:17.592166 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:17.591926    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824707dd-686f-4622-986a-70f0a3aac092-console-oauth-config\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:18.152408 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.152371    2573 generic.go:356] "Generic (PLEG): container finished" podID="824707dd-686f-4622-986a-70f0a3aac092" containerID="5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079" exitCode=0
Jul 08 07:03:18.152886 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.152421    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f66b95d4-wbctg"
Jul 08 07:03:18.152886 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.152439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f66b95d4-wbctg" event={"ID":"824707dd-686f-4622-986a-70f0a3aac092","Type":"ContainerDied","Data":"5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079"}
Jul 08 07:03:18.152886 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.152490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f66b95d4-wbctg" event={"ID":"824707dd-686f-4622-986a-70f0a3aac092","Type":"ContainerDied","Data":"ffdeeba7fcc94c07d4944d8a2fb105c19c045dbc35f63523108527c2784b11d1"}
Jul 08 07:03:18.152886 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.152516    2573 scope.go:117] "RemoveContainer" containerID="5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079"
Jul 08 07:03:18.161435 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.161417    2573 scope.go:117] "RemoveContainer" containerID="5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079"
Jul 08 07:03:18.161720 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:03:18.161700    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079\": container with ID starting with 5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079 not found: ID does not exist" containerID="5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079"
Jul 08 07:03:18.161816 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.161730    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079"} err="failed to get container status \"5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079\": rpc error: code = NotFound desc = could not find container \"5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079\": container with ID starting with 5181c428b47f1472d3c9c6091ee41ea20cd2707a3d2d209d74bf86154923b079 not found: ID does not exist"
Jul 08 07:03:18.184668 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.184640    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f66b95d4-wbctg"]
Jul 08 07:03:18.198417 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.198389    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85f66b95d4-wbctg"]
Jul 08 07:03:18.820842 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:18.820747    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824707dd-686f-4622-986a-70f0a3aac092" path="/var/lib/kubelet/pods/824707dd-686f-4622-986a-70f0a3aac092/volumes"
Jul 08 07:03:23.518956 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.518916    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"]
Jul 08 07:03:23.519399 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.519258    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824707dd-686f-4622-986a-70f0a3aac092" containerName="console"
Jul 08 07:03:23.519399 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.519269    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="824707dd-686f-4622-986a-70f0a3aac092" containerName="console"
Jul 08 07:03:23.519399 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.519332    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="824707dd-686f-4622-986a-70f0a3aac092" containerName="console"
Jul 08 07:03:23.524242 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.524222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.527138 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.527118    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 07:03:23.527138 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.527125    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 07:03:23.527344 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.527184    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lkxw9\""
Jul 08 07:03:23.530861 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.530832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"]
Jul 08 07:03:23.539577 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.539451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.539787 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.539581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkrtn\" (UniqueName: \"kubernetes.io/projected/7695239f-70a1-4c4b-b761-cf98e78b00d3-kube-api-access-fkrtn\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.539787 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.539617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.620069 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.620032    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"]
Jul 08 07:03:23.623555 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.623537    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.631404 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.631374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"]
Jul 08 07:03:23.640396 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.640319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.640396 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.640367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg8t4\" (UniqueName: \"kubernetes.io/projected/2ca1d5be-81c5-4bba-839d-41841284d20c-kube-api-access-qg8t4\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.640704 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.640410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.640704 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.640439    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.640704 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.640491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkrtn\" (UniqueName: \"kubernetes.io/projected/7695239f-70a1-4c4b-b761-cf98e78b00d3-kube-api-access-fkrtn\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.640704 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.640524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.641119 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.641097    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.641181 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.641104    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.648449 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.648420    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkrtn\" (UniqueName: \"kubernetes.io/projected/7695239f-70a1-4c4b-b761-cf98e78b00d3-kube-api-access-fkrtn\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.723913 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.723874    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"]
Jul 08 07:03:23.727593 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.727575    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.735457 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.735428    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"]
Jul 08 07:03:23.740944 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.740914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.741117 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.740972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.741117 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.740992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg8t4\" (UniqueName: \"kubernetes.io/projected/2ca1d5be-81c5-4bba-839d-41841284d20c-kube-api-access-qg8t4\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.741117 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.741011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.741117 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.741030    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.741117 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.741064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d9db\" (UniqueName: \"kubernetes.io/projected/b18cfd78-8815-4ce2-83e0-8b87313da287-kube-api-access-8d9db\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.741367 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.741276    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.741409 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.741392    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.749231 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.749196    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg8t4\" (UniqueName: \"kubernetes.io/projected/2ca1d5be-81c5-4bba-839d-41841284d20c-kube-api-access-qg8t4\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.828052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.827961    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"]
Jul 08 07:03:23.831855 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.831828    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.835143 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.835119    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:23.840639 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.840615    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"]
Jul 08 07:03:23.842145 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.842277 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d9db\" (UniqueName: \"kubernetes.io/projected/b18cfd78-8815-4ce2-83e0-8b87313da287-kube-api-access-8d9db\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.842277 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.842392 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.842392 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx6bf\" (UniqueName: \"kubernetes.io/projected/20903fbb-726e-49cb-8b0b-928544a9cf56-kube-api-access-vx6bf\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.842499 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.842696 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842675    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.842817 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.842718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.853688 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.853660    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d9db\" (UniqueName: \"kubernetes.io/projected/b18cfd78-8815-4ce2-83e0-8b87313da287-kube-api-access-8d9db\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:23.934100 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.934068    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:23.943641 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.943596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx6bf\" (UniqueName: \"kubernetes.io/projected/20903fbb-726e-49cb-8b0b-928544a9cf56-kube-api-access-vx6bf\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.943843 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.943693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.943843 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.943773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.944151 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.944129    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.944260 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.944175    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.952692 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.952657    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx6bf\" (UniqueName: \"kubernetes.io/projected/20903fbb-726e-49cb-8b0b-928544a9cf56-kube-api-access-vx6bf\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:23.979367 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:23.979213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"]
Jul 08 07:03:23.982170 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:03:23.982141    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7695239f_70a1_4c4b_b761_cf98e78b00d3.slice/crio-18a7355e8041a41936bc9549bca14e72e32a8a71698fc8cfd53f78f14b64b6b2 WatchSource:0}: Error finding container 18a7355e8041a41936bc9549bca14e72e32a8a71698fc8cfd53f78f14b64b6b2: Status 404 returned error can't find the container with id 18a7355e8041a41936bc9549bca14e72e32a8a71698fc8cfd53f78f14b64b6b2
Jul 08 07:03:24.037718 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.037683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:24.083383 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.083358    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"]
Jul 08 07:03:24.087167 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:03:24.087131    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca1d5be_81c5_4bba_839d_41841284d20c.slice/crio-5be9cf319276a75d2c5b0f0a300ed39915afd866c68cb8428530843b37d59643 WatchSource:0}: Error finding container 5be9cf319276a75d2c5b0f0a300ed39915afd866c68cb8428530843b37d59643: Status 404 returned error can't find the container with id 5be9cf319276a75d2c5b0f0a300ed39915afd866c68cb8428530843b37d59643
Jul 08 07:03:24.143248 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.143219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:24.184832 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.184793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg" event={"ID":"2ca1d5be-81c5-4bba-839d-41841284d20c","Type":"ContainerStarted","Data":"5be9cf319276a75d2c5b0f0a300ed39915afd866c68cb8428530843b37d59643"}
Jul 08 07:03:24.186381 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.186351    2573 generic.go:356] "Generic (PLEG): container finished" podID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerID="1244633dbd675ef0a0d1d5bc2162e186b5153b378c0bbd83fc976b32acc30ee0" exitCode=0
Jul 08 07:03:24.186521 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.186428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr" event={"ID":"7695239f-70a1-4c4b-b761-cf98e78b00d3","Type":"ContainerDied","Data":"1244633dbd675ef0a0d1d5bc2162e186b5153b378c0bbd83fc976b32acc30ee0"}
Jul 08 07:03:24.186521 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.186479    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr" event={"ID":"7695239f-70a1-4c4b-b761-cf98e78b00d3","Type":"ContainerStarted","Data":"18a7355e8041a41936bc9549bca14e72e32a8a71698fc8cfd53f78f14b64b6b2"}
Jul 08 07:03:24.195841 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.195712    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"]
Jul 08 07:03:24.197631 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:03:24.197596    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18cfd78_8815_4ce2_83e0_8b87313da287.slice/crio-b18b8ea18ec3042bf42b2a834e00fa7cab5100ae7b9a07c5014236da5f769c0e WatchSource:0}: Error finding container b18b8ea18ec3042bf42b2a834e00fa7cab5100ae7b9a07c5014236da5f769c0e: Status 404 returned error can't find the container with id b18b8ea18ec3042bf42b2a834e00fa7cab5100ae7b9a07c5014236da5f769c0e
Jul 08 07:03:24.302629 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:24.302601    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"]
Jul 08 07:03:24.310838 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:03:24.310806    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20903fbb_726e_49cb_8b0b_928544a9cf56.slice/crio-72a7d81e36a9e61e0dca122f95709080b59d298f684b88498688478458fed691 WatchSource:0}: Error finding container 72a7d81e36a9e61e0dca122f95709080b59d298f684b88498688478458fed691: Status 404 returned error can't find the container with id 72a7d81e36a9e61e0dca122f95709080b59d298f684b88498688478458fed691
Jul 08 07:03:25.192487 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.192451    2573 generic.go:356] "Generic (PLEG): container finished" podID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerID="f4baaece9ba475b92972aee22e1359292c78a32e08c426d719433ca4cc2f859d" exitCode=0
Jul 08 07:03:25.192965 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.192532    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg" event={"ID":"2ca1d5be-81c5-4bba-839d-41841284d20c","Type":"ContainerDied","Data":"f4baaece9ba475b92972aee22e1359292c78a32e08c426d719433ca4cc2f859d"}
Jul 08 07:03:25.194134 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.194111    2573 generic.go:356] "Generic (PLEG): container finished" podID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerID="231016c099ed5a0fe816bd102ac0a1257a5cc37c5e9790ebf18169658f0cae3d" exitCode=0
Jul 08 07:03:25.194222 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.194198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl" event={"ID":"20903fbb-726e-49cb-8b0b-928544a9cf56","Type":"ContainerDied","Data":"231016c099ed5a0fe816bd102ac0a1257a5cc37c5e9790ebf18169658f0cae3d"}
Jul 08 07:03:25.194282 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.194252    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl" event={"ID":"20903fbb-726e-49cb-8b0b-928544a9cf56","Type":"ContainerStarted","Data":"72a7d81e36a9e61e0dca122f95709080b59d298f684b88498688478458fed691"}
Jul 08 07:03:25.196028 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.195977    2573 generic.go:356] "Generic (PLEG): container finished" podID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerID="c2488c913d00424912416b558d0fc8299d09a7e3ada145876101c9639b39e0e0" exitCode=0
Jul 08 07:03:25.196139 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.196060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t" event={"ID":"b18cfd78-8815-4ce2-83e0-8b87313da287","Type":"ContainerDied","Data":"c2488c913d00424912416b558d0fc8299d09a7e3ada145876101c9639b39e0e0"}
Jul 08 07:03:25.196139 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:25.196108    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t" event={"ID":"b18cfd78-8815-4ce2-83e0-8b87313da287","Type":"ContainerStarted","Data":"b18b8ea18ec3042bf42b2a834e00fa7cab5100ae7b9a07c5014236da5f769c0e"}
Jul 08 07:03:27.208262 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:27.208235    2573 generic.go:356] "Generic (PLEG): container finished" podID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerID="a27950aa1d7446ff86099c0cb39a64cebd279a94072f0f925f5ba20595cec407" exitCode=0
Jul 08 07:03:27.208647 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:27.208317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t" event={"ID":"b18cfd78-8815-4ce2-83e0-8b87313da287","Type":"ContainerDied","Data":"a27950aa1d7446ff86099c0cb39a64cebd279a94072f0f925f5ba20595cec407"}
Jul 08 07:03:27.210225 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:27.210206    2573 generic.go:356] "Generic (PLEG): container finished" podID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerID="b9f75543603dc6e51584f46399d9aad9ecd38b958cb6fc6ba41910ad5fffd33e" exitCode=0
Jul 08 07:03:27.210323 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:27.210276    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg" event={"ID":"2ca1d5be-81c5-4bba-839d-41841284d20c","Type":"ContainerDied","Data":"b9f75543603dc6e51584f46399d9aad9ecd38b958cb6fc6ba41910ad5fffd33e"}
Jul 08 07:03:28.216926 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:28.216896    2573 generic.go:356] "Generic (PLEG): container finished" podID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerID="4ff7c603bb43aa92e160ed6950a596b2f4097506bc7cff1ba6d335d8ae2de3eb" exitCode=0
Jul 08 07:03:28.217284 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:28.216971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr" event={"ID":"7695239f-70a1-4c4b-b761-cf98e78b00d3","Type":"ContainerDied","Data":"4ff7c603bb43aa92e160ed6950a596b2f4097506bc7cff1ba6d335d8ae2de3eb"}
Jul 08 07:03:28.219255 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:28.219236    2573 generic.go:356] "Generic (PLEG): container finished" podID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerID="d79bedbcfd55daae0ca5fd998fbb60680585cb84d13083ffa46bb5c68e214907" exitCode=0
Jul 08 07:03:28.219383 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:28.219310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t" event={"ID":"b18cfd78-8815-4ce2-83e0-8b87313da287","Type":"ContainerDied","Data":"d79bedbcfd55daae0ca5fd998fbb60680585cb84d13083ffa46bb5c68e214907"}
Jul 08 07:03:28.221286 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:28.221263    2573 generic.go:356] "Generic (PLEG): container finished" podID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerID="a4cc0a9e2c5a5a1ae764ab384d44badd4897a0a0971797ed6ac4eb9301f3a30a" exitCode=0
Jul 08 07:03:28.221391 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:28.221307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg" event={"ID":"2ca1d5be-81c5-4bba-839d-41841284d20c","Type":"ContainerDied","Data":"a4cc0a9e2c5a5a1ae764ab384d44badd4897a0a0971797ed6ac4eb9301f3a30a"}
Jul 08 07:03:29.227937 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.227902    2573 generic.go:356] "Generic (PLEG): container finished" podID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerID="8839672b2436014787c7912f8b839e520df72190c505c615cfdabf6f9a2b719f" exitCode=0
Jul 08 07:03:29.228370 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.227989    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr" event={"ID":"7695239f-70a1-4c4b-b761-cf98e78b00d3","Type":"ContainerDied","Data":"8839672b2436014787c7912f8b839e520df72190c505c615cfdabf6f9a2b719f"}
Jul 08 07:03:29.399543 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.399519    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:29.403428 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.403403    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:29.490008 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.489983    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-bundle\") pod \"b18cfd78-8815-4ce2-83e0-8b87313da287\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") "
Jul 08 07:03:29.490170 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.490042    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-bundle\") pod \"2ca1d5be-81c5-4bba-839d-41841284d20c\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") "
Jul 08 07:03:29.490170 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.490068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg8t4\" (UniqueName: \"kubernetes.io/projected/2ca1d5be-81c5-4bba-839d-41841284d20c-kube-api-access-qg8t4\") pod \"2ca1d5be-81c5-4bba-839d-41841284d20c\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") "
Jul 08 07:03:29.490170 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.490087    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-util\") pod \"2ca1d5be-81c5-4bba-839d-41841284d20c\" (UID: \"2ca1d5be-81c5-4bba-839d-41841284d20c\") "
Jul 08 07:03:29.490170 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.490125    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d9db\" (UniqueName: \"kubernetes.io/projected/b18cfd78-8815-4ce2-83e0-8b87313da287-kube-api-access-8d9db\") pod \"b18cfd78-8815-4ce2-83e0-8b87313da287\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") "
Jul 08 07:03:29.490380 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.490182    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-util\") pod \"b18cfd78-8815-4ce2-83e0-8b87313da287\" (UID: \"b18cfd78-8815-4ce2-83e0-8b87313da287\") "
Jul 08 07:03:29.490794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.490746    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-bundle" (OuterVolumeSpecName: "bundle") pod "2ca1d5be-81c5-4bba-839d-41841284d20c" (UID: "2ca1d5be-81c5-4bba-839d-41841284d20c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:29.490991 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.490952    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-bundle" (OuterVolumeSpecName: "bundle") pod "b18cfd78-8815-4ce2-83e0-8b87313da287" (UID: "b18cfd78-8815-4ce2-83e0-8b87313da287"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:29.492320 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.492295    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18cfd78-8815-4ce2-83e0-8b87313da287-kube-api-access-8d9db" (OuterVolumeSpecName: "kube-api-access-8d9db") pod "b18cfd78-8815-4ce2-83e0-8b87313da287" (UID: "b18cfd78-8815-4ce2-83e0-8b87313da287"). InnerVolumeSpecName "kube-api-access-8d9db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:03:29.492412 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.492334    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ca1d5be-81c5-4bba-839d-41841284d20c-kube-api-access-qg8t4" (OuterVolumeSpecName: "kube-api-access-qg8t4") pod "2ca1d5be-81c5-4bba-839d-41841284d20c" (UID: "2ca1d5be-81c5-4bba-839d-41841284d20c"). InnerVolumeSpecName "kube-api-access-qg8t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:03:29.591077 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.591034    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:29.591077 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.591065    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:29.591077 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.591075    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg8t4\" (UniqueName: \"kubernetes.io/projected/2ca1d5be-81c5-4bba-839d-41841284d20c-kube-api-access-qg8t4\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:29.591077 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.591085    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d9db\" (UniqueName: \"kubernetes.io/projected/b18cfd78-8815-4ce2-83e0-8b87313da287-kube-api-access-8d9db\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:29.748495 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.748413    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-util" (OuterVolumeSpecName: "util") pod "2ca1d5be-81c5-4bba-839d-41841284d20c" (UID: "2ca1d5be-81c5-4bba-839d-41841284d20c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:29.748495 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.748417    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-util" (OuterVolumeSpecName: "util") pod "b18cfd78-8815-4ce2-83e0-8b87313da287" (UID: "b18cfd78-8815-4ce2-83e0-8b87313da287"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:29.793503 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.793471    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ca1d5be-81c5-4bba-839d-41841284d20c-util\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:29.793503 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:29.793498    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18cfd78-8815-4ce2-83e0-8b87313da287-util\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:30.236005 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.235923    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t"
Jul 08 07:03:30.236005 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.235945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead764zv7t" event={"ID":"b18cfd78-8815-4ce2-83e0-8b87313da287","Type":"ContainerDied","Data":"b18b8ea18ec3042bf42b2a834e00fa7cab5100ae7b9a07c5014236da5f769c0e"}
Jul 08 07:03:30.236005 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.235998    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b18b8ea18ec3042bf42b2a834e00fa7cab5100ae7b9a07c5014236da5f769c0e"
Jul 08 07:03:30.237794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.237754    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg"
Jul 08 07:03:30.237899 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.237792    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabfqccg" event={"ID":"2ca1d5be-81c5-4bba-839d-41841284d20c","Type":"ContainerDied","Data":"5be9cf319276a75d2c5b0f0a300ed39915afd866c68cb8428530843b37d59643"}
Jul 08 07:03:30.237899 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.237837    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5be9cf319276a75d2c5b0f0a300ed39915afd866c68cb8428530843b37d59643"
Jul 08 07:03:30.359521 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.359493    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:30.399514 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.399477    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-util\") pod \"7695239f-70a1-4c4b-b761-cf98e78b00d3\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") "
Jul 08 07:03:30.399707 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.399541    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkrtn\" (UniqueName: \"kubernetes.io/projected/7695239f-70a1-4c4b-b761-cf98e78b00d3-kube-api-access-fkrtn\") pod \"7695239f-70a1-4c4b-b761-cf98e78b00d3\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") "
Jul 08 07:03:30.399707 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.399570    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-bundle\") pod \"7695239f-70a1-4c4b-b761-cf98e78b00d3\" (UID: \"7695239f-70a1-4c4b-b761-cf98e78b00d3\") "
Jul 08 07:03:30.400108 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.400076    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-bundle" (OuterVolumeSpecName: "bundle") pod "7695239f-70a1-4c4b-b761-cf98e78b00d3" (UID: "7695239f-70a1-4c4b-b761-cf98e78b00d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:30.401711 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.401680    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7695239f-70a1-4c4b-b761-cf98e78b00d3-kube-api-access-fkrtn" (OuterVolumeSpecName: "kube-api-access-fkrtn") pod "7695239f-70a1-4c4b-b761-cf98e78b00d3" (UID: "7695239f-70a1-4c4b-b761-cf98e78b00d3"). InnerVolumeSpecName "kube-api-access-fkrtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:03:30.403871 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.403830    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-util" (OuterVolumeSpecName: "util") pod "7695239f-70a1-4c4b-b761-cf98e78b00d3" (UID: "7695239f-70a1-4c4b-b761-cf98e78b00d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:30.501162 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.501133    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkrtn\" (UniqueName: \"kubernetes.io/projected/7695239f-70a1-4c4b-b761-cf98e78b00d3-kube-api-access-fkrtn\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:30.501162 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.501159    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:30.501353 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:30.501169    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7695239f-70a1-4c4b-b761-cf98e78b00d3-util\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:31.244696 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:31.244668    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr"
Jul 08 07:03:31.245134 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:31.244691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef5gprr" event={"ID":"7695239f-70a1-4c4b-b761-cf98e78b00d3","Type":"ContainerDied","Data":"18a7355e8041a41936bc9549bca14e72e32a8a71698fc8cfd53f78f14b64b6b2"}
Jul 08 07:03:31.245134 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:31.244736    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18a7355e8041a41936bc9549bca14e72e32a8a71698fc8cfd53f78f14b64b6b2"
Jul 08 07:03:43.305834 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:43.305801    2573 generic.go:356] "Generic (PLEG): container finished" podID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerID="d4e9229a52852455132a74c6b4831d07b5e4522c6cc19275de6197972f0aeb84" exitCode=0
Jul 08 07:03:43.306207 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:43.305857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl" event={"ID":"20903fbb-726e-49cb-8b0b-928544a9cf56","Type":"ContainerDied","Data":"d4e9229a52852455132a74c6b4831d07b5e4522c6cc19275de6197972f0aeb84"}
Jul 08 07:03:44.314740 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:44.314708    2573 generic.go:356] "Generic (PLEG): container finished" podID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerID="3b33de441d40b55b49817bf3eeb2b01729d9540c37987fbfc30118e52869cfd7" exitCode=0
Jul 08 07:03:44.315137 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:44.314798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl" event={"ID":"20903fbb-726e-49cb-8b0b-928544a9cf56","Type":"ContainerDied","Data":"3b33de441d40b55b49817bf3eeb2b01729d9540c37987fbfc30118e52869cfd7"}
Jul 08 07:03:45.454832 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.454805    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:03:45.529416 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.529383    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx6bf\" (UniqueName: \"kubernetes.io/projected/20903fbb-726e-49cb-8b0b-928544a9cf56-kube-api-access-vx6bf\") pod \"20903fbb-726e-49cb-8b0b-928544a9cf56\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") "
Jul 08 07:03:45.529599 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.529428    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-bundle\") pod \"20903fbb-726e-49cb-8b0b-928544a9cf56\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") "
Jul 08 07:03:45.529599 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.529446    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-util\") pod \"20903fbb-726e-49cb-8b0b-928544a9cf56\" (UID: \"20903fbb-726e-49cb-8b0b-928544a9cf56\") "
Jul 08 07:03:45.530070 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.530037    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-bundle" (OuterVolumeSpecName: "bundle") pod "20903fbb-726e-49cb-8b0b-928544a9cf56" (UID: "20903fbb-726e-49cb-8b0b-928544a9cf56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:45.531529 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.531499    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20903fbb-726e-49cb-8b0b-928544a9cf56-kube-api-access-vx6bf" (OuterVolumeSpecName: "kube-api-access-vx6bf") pod "20903fbb-726e-49cb-8b0b-928544a9cf56" (UID: "20903fbb-726e-49cb-8b0b-928544a9cf56"). InnerVolumeSpecName "kube-api-access-vx6bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:03:45.536004 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.535975    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-util" (OuterVolumeSpecName: "util") pod "20903fbb-726e-49cb-8b0b-928544a9cf56" (UID: "20903fbb-726e-49cb-8b0b-928544a9cf56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:03:45.630263 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.630168    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx6bf\" (UniqueName: \"kubernetes.io/projected/20903fbb-726e-49cb-8b0b-928544a9cf56-kube-api-access-vx6bf\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:45.630263 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.630209    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-bundle\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:45.630263 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:45.630218    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20903fbb-726e-49cb-8b0b-928544a9cf56-util\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:03:46.326596 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:46.326563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl" event={"ID":"20903fbb-726e-49cb-8b0b-928544a9cf56","Type":"ContainerDied","Data":"72a7d81e36a9e61e0dca122f95709080b59d298f684b88498688478458fed691"}
Jul 08 07:03:46.326839 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:46.326619    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72a7d81e36a9e61e0dca122f95709080b59d298f684b88498688478458fed691"
Jul 08 07:03:46.326839 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:03:46.326573    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36m5rzl"
Jul 08 07:04:00.811319 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811283    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-g2z8f"]
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811606    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerName="extract"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811616    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerName="extract"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811627    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811632    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811638    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerName="extract"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811643    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerName="extract"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811653    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811658    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811663    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811667    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811673    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811678    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811684    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811688    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811698    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811704    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811710    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811714    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerName="pull"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811723    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerName="extract"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811732    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerName="extract"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811740    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811745    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerName="util"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811752    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerName="extract"
Jul 08 07:04:00.811795 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811757    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerName="extract"
Jul 08 07:04:00.812576 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811823    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="20903fbb-726e-49cb-8b0b-928544a9cf56" containerName="extract"
Jul 08 07:04:00.812576 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811834    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ca1d5be-81c5-4bba-839d-41841284d20c" containerName="extract"
Jul 08 07:04:00.812576 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811840    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7695239f-70a1-4c4b-b761-cf98e78b00d3" containerName="extract"
Jul 08 07:04:00.812576 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.811845    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18cfd78-8815-4ce2-83e0-8b87313da287" containerName="extract"
Jul 08 07:04:00.818315 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.818291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f"
Jul 08 07:04:00.826659 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.822372    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 07:04:00.826659 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.822646    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 07:04:00.826659 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.823015    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-smhcn\""
Jul 08 07:04:00.836193 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.836169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-g2z8f"]
Jul 08 07:04:00.956035 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:00.956002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7tl\" (UniqueName: \"kubernetes.io/projected/d44bc792-ede6-4270-9efa-10f86c2ce01d-kube-api-access-kr7tl\") pod \"authorino-operator-6d85f6564-g2z8f\" (UID: \"d44bc792-ede6-4270-9efa-10f86c2ce01d\") " pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f"
Jul 08 07:04:01.057186 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:01.057146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7tl\" (UniqueName: \"kubernetes.io/projected/d44bc792-ede6-4270-9efa-10f86c2ce01d-kube-api-access-kr7tl\") pod \"authorino-operator-6d85f6564-g2z8f\" (UID: \"d44bc792-ede6-4270-9efa-10f86c2ce01d\") " pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f"
Jul 08 07:04:01.071977 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:01.071902    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7tl\" (UniqueName: \"kubernetes.io/projected/d44bc792-ede6-4270-9efa-10f86c2ce01d-kube-api-access-kr7tl\") pod \"authorino-operator-6d85f6564-g2z8f\" (UID: \"d44bc792-ede6-4270-9efa-10f86c2ce01d\") " pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f"
Jul 08 07:04:01.135582 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:01.135547    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f"
Jul 08 07:04:01.274112 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:01.274086    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-g2z8f"]
Jul 08 07:04:01.276048 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:04:01.276018    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44bc792_ede6_4270_9efa_10f86c2ce01d.slice/crio-d06cbad1a381059e5950bd17195236076779a0f1b2c37ef583deaec7bdda34bc WatchSource:0}: Error finding container d06cbad1a381059e5950bd17195236076779a0f1b2c37ef583deaec7bdda34bc: Status 404 returned error can't find the container with id d06cbad1a381059e5950bd17195236076779a0f1b2c37ef583deaec7bdda34bc
Jul 08 07:04:01.397911 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:01.397822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f" event={"ID":"d44bc792-ede6-4270-9efa-10f86c2ce01d","Type":"ContainerStarted","Data":"d06cbad1a381059e5950bd17195236076779a0f1b2c37ef583deaec7bdda34bc"}
Jul 08 07:04:04.417943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:04.417910    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f" event={"ID":"d44bc792-ede6-4270-9efa-10f86c2ce01d","Type":"ContainerStarted","Data":"67f4c6d757049142c3f5893353a20e953ac07b293b4e941eb8e0e71924eb061a"}
Jul 08 07:04:04.418308 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:04.417976    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f"
Jul 08 07:04:04.438336 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:04.438282    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f" podStartSLOduration=1.7982964799999999 podStartE2EDuration="4.438267102s" totalImagesPullingTime="2.639970622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:04:04.435660046 +0000 UTC m=+564.131180928" watchObservedRunningTime="2026-07-08 07:04:04.438267102 +0000 UTC m=+564.133787982"
Jul 08 07:04:09.336101 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.336065    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"]
Jul 08 07:04:09.339542 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.339526    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"
Jul 08 07:04:09.342192 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.342169    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mjtn5\""
Jul 08 07:04:09.342297 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.342171    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 07:04:09.351987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.351961    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"]
Jul 08 07:04:09.435945 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.435909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hrs4\" (UniqueName: \"kubernetes.io/projected/016089e7-2b19-435e-bfe0-dddf6a666ce7-kube-api-access-7hrs4\") pod \"dns-operator-controller-manager-65b49595d7-p6hz9\" (UID: \"016089e7-2b19-435e-bfe0-dddf6a666ce7\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"
Jul 08 07:04:09.536468 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.536437    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hrs4\" (UniqueName: \"kubernetes.io/projected/016089e7-2b19-435e-bfe0-dddf6a666ce7-kube-api-access-7hrs4\") pod \"dns-operator-controller-manager-65b49595d7-p6hz9\" (UID: \"016089e7-2b19-435e-bfe0-dddf6a666ce7\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"
Jul 08 07:04:09.546779 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.546736    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hrs4\" (UniqueName: \"kubernetes.io/projected/016089e7-2b19-435e-bfe0-dddf6a666ce7-kube-api-access-7hrs4\") pod \"dns-operator-controller-manager-65b49595d7-p6hz9\" (UID: \"016089e7-2b19-435e-bfe0-dddf6a666ce7\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"
Jul 08 07:04:09.649360 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.649275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"
Jul 08 07:04:09.792961 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:09.792938    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"]
Jul 08 07:04:09.795142 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:04:09.795110    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016089e7_2b19_435e_bfe0_dddf6a666ce7.slice/crio-ec45314fabb37e26fc9c78557a0d5c2382add343dac4ed348cb10e4175d6810f WatchSource:0}: Error finding container ec45314fabb37e26fc9c78557a0d5c2382add343dac4ed348cb10e4175d6810f: Status 404 returned error can't find the container with id ec45314fabb37e26fc9c78557a0d5c2382add343dac4ed348cb10e4175d6810f
Jul 08 07:04:10.454266 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:10.454228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9" event={"ID":"016089e7-2b19-435e-bfe0-dddf6a666ce7","Type":"ContainerStarted","Data":"ec45314fabb37e26fc9c78557a0d5c2382add343dac4ed348cb10e4175d6810f"}
Jul 08 07:04:11.743157 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:11.743120    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"]
Jul 08 07:04:11.753790 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:11.753749    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"
Jul 08 07:04:11.757016 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:11.756794    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ss5qm\""
Jul 08 07:04:11.758231 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:11.758208    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"]
Jul 08 07:04:11.856538 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:11.856499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78gvv\" (UniqueName: \"kubernetes.io/projected/3888a24c-eb3e-4edd-86a2-396a3d90767e-kube-api-access-78gvv\") pod \"limitador-operator-controller-manager-6f9f468797-xglwg\" (UID: \"3888a24c-eb3e-4edd-86a2-396a3d90767e\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"
Jul 08 07:04:11.957416 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:11.957374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78gvv\" (UniqueName: \"kubernetes.io/projected/3888a24c-eb3e-4edd-86a2-396a3d90767e-kube-api-access-78gvv\") pod \"limitador-operator-controller-manager-6f9f468797-xglwg\" (UID: \"3888a24c-eb3e-4edd-86a2-396a3d90767e\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"
Jul 08 07:04:11.979205 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:11.979175    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78gvv\" (UniqueName: \"kubernetes.io/projected/3888a24c-eb3e-4edd-86a2-396a3d90767e-kube-api-access-78gvv\") pod \"limitador-operator-controller-manager-6f9f468797-xglwg\" (UID: \"3888a24c-eb3e-4edd-86a2-396a3d90767e\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"
Jul 08 07:04:12.068974 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:12.068879    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"
Jul 08 07:04:12.357958 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:12.357925    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"]
Jul 08 07:04:12.359559 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:04:12.359533    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3888a24c_eb3e_4edd_86a2_396a3d90767e.slice/crio-376f3e04efe23d74fb64d2a3ba51e78dd352f502710323e3501afb0c55007c9b WatchSource:0}: Error finding container 376f3e04efe23d74fb64d2a3ba51e78dd352f502710323e3501afb0c55007c9b: Status 404 returned error can't find the container with id 376f3e04efe23d74fb64d2a3ba51e78dd352f502710323e3501afb0c55007c9b
Jul 08 07:04:12.471709 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:12.471667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9" event={"ID":"016089e7-2b19-435e-bfe0-dddf6a666ce7","Type":"ContainerStarted","Data":"50b2b4610a94018b7cb9ab3ff752bff69c4a2e143b91a450cf6e91923af77190"}
Jul 08 07:04:12.471912 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:12.471863    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"
Jul 08 07:04:12.473014 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:12.472989    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg" event={"ID":"3888a24c-eb3e-4edd-86a2-396a3d90767e","Type":"ContainerStarted","Data":"376f3e04efe23d74fb64d2a3ba51e78dd352f502710323e3501afb0c55007c9b"}
Jul 08 07:04:12.492283 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:12.492231    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9" podStartSLOduration=0.997579102 podStartE2EDuration="3.492216937s" totalImagesPullingTime="2.494637835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:04:12.490600812 +0000 UTC m=+572.186121693" watchObservedRunningTime="2026-07-08 07:04:12.492216937 +0000 UTC m=+572.187737817"
Jul 08 07:04:14.484140 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:14.484109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg" event={"ID":"3888a24c-eb3e-4edd-86a2-396a3d90767e","Type":"ContainerStarted","Data":"50e0e3d7c38a5c580f74b58330bddc2611bc6be1cd1e12d1569c42115758f4fa"}
Jul 08 07:04:14.484512 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:14.484246    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"
Jul 08 07:04:14.503381 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:14.503323    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg" podStartSLOduration=2.370115678 podStartE2EDuration="3.503309445s" totalImagesPullingTime="1.133193767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:04:14.500618404 +0000 UTC m=+574.196139286" watchObservedRunningTime="2026-07-08 07:04:14.503309445 +0000 UTC m=+574.198830325"
Jul 08 07:04:15.425935 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:15.425905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-g2z8f"
Jul 08 07:04:23.480678 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:23.480646    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-p6hz9"
Jul 08 07:04:25.492790 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:04:25.492735    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-xglwg"
Jul 08 07:05:04.593099 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.593021    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-q5lkg"]
Jul 08 07:05:04.596465 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.596450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:04.598696 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.598673    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mps7s\""
Jul 08 07:05:04.598844 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.598675    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 07:05:04.604037 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.604012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-q5lkg"]
Jul 08 07:05:04.631328 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.631301    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-q5lkg"]
Jul 08 07:05:04.703786 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.703737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqk4j\" (UniqueName: \"kubernetes.io/projected/a46afd3e-4f24-487d-8037-bd42eb7899ca-kube-api-access-tqk4j\") pod \"limitador-limitador-69574b596d-q5lkg\" (UID: \"a46afd3e-4f24-487d-8037-bd42eb7899ca\") " pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:04.703963 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.703852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a46afd3e-4f24-487d-8037-bd42eb7899ca-config-file\") pod \"limitador-limitador-69574b596d-q5lkg\" (UID: \"a46afd3e-4f24-487d-8037-bd42eb7899ca\") " pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:04.805290 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.805254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a46afd3e-4f24-487d-8037-bd42eb7899ca-config-file\") pod \"limitador-limitador-69574b596d-q5lkg\" (UID: \"a46afd3e-4f24-487d-8037-bd42eb7899ca\") " pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:04.805472 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.805328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqk4j\" (UniqueName: \"kubernetes.io/projected/a46afd3e-4f24-487d-8037-bd42eb7899ca-kube-api-access-tqk4j\") pod \"limitador-limitador-69574b596d-q5lkg\" (UID: \"a46afd3e-4f24-487d-8037-bd42eb7899ca\") " pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:04.805910 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.805890    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a46afd3e-4f24-487d-8037-bd42eb7899ca-config-file\") pod \"limitador-limitador-69574b596d-q5lkg\" (UID: \"a46afd3e-4f24-487d-8037-bd42eb7899ca\") " pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:04.813009 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.812984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqk4j\" (UniqueName: \"kubernetes.io/projected/a46afd3e-4f24-487d-8037-bd42eb7899ca-kube-api-access-tqk4j\") pod \"limitador-limitador-69574b596d-q5lkg\" (UID: \"a46afd3e-4f24-487d-8037-bd42eb7899ca\") " pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:04.907343 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:04.907273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:05.036043 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:05.036015    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-q5lkg"]
Jul 08 07:05:05.037788 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:05:05.037735    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46afd3e_4f24_487d_8037_bd42eb7899ca.slice/crio-1803b13572c559b4d64d627fe992c47c582ff77141ba8fd7f041fd3b3b0f0cb8 WatchSource:0}: Error finding container 1803b13572c559b4d64d627fe992c47c582ff77141ba8fd7f041fd3b3b0f0cb8: Status 404 returned error can't find the container with id 1803b13572c559b4d64d627fe992c47c582ff77141ba8fd7f041fd3b3b0f0cb8
Jul 08 07:05:05.039792 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:05.039777    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 07:05:05.743351 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:05.743315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg" event={"ID":"a46afd3e-4f24-487d-8037-bd42eb7899ca","Type":"ContainerStarted","Data":"1803b13572c559b4d64d627fe992c47c582ff77141ba8fd7f041fd3b3b0f0cb8"}
Jul 08 07:05:09.767114 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:09.767079    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg" event={"ID":"a46afd3e-4f24-487d-8037-bd42eb7899ca","Type":"ContainerStarted","Data":"073b71927ffc8ef5fa0c536aae3ad29f1f0e6da178f4b390f87fbbc6570fe955"}
Jul 08 07:05:09.767485 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:09.767211    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:05:09.784481 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:09.784427    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg" podStartSLOduration=1.9465399030000001 podStartE2EDuration="5.784411722s" totalImagesPullingTime="3.837871819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:05:09.782663392 +0000 UTC m=+629.478184285" watchObservedRunningTime="2026-07-08 07:05:09.784411722 +0000 UTC m=+629.479932601"
Jul 08 07:05:20.773436 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:05:20.773407    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-q5lkg"
Jul 08 07:08:12.488375 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.488340    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"]
Jul 08 07:08:12.491988 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.491966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.494261 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.494240    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:08:12.494261 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.494253    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:08:12.494416 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.494256    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-kserve-self-signed-certs\""
Jul 08 07:08:12.495060 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.495046    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:08:12.495145 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.495130    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-psjvw\""
Jul 08 07:08:12.502333 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.502305    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"]
Jul 08 07:08:12.621880 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.621829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-dshm\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.622063 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.621972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-model-cache\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.622063 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.622017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.622063 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.622038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mk5h\" (UniqueName: \"kubernetes.io/projected/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kube-api-access-5mk5h\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.622195 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.622119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-home\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.622195 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.622138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tmp-dir\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.622195 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.622177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tls-certs\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723188 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723153    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-home\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723188 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tmp-dir\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723445 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tls-certs\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723445 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-dshm\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723445 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-model-cache\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723445 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723445 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mk5h\" (UniqueName: \"kubernetes.io/projected/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kube-api-access-5mk5h\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723745 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723619    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-home\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.723962 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tmp-dir\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.724093 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723955    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.724093 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.723986    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-model-cache\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.725728 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.725707    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-dshm\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.725860 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.725734    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tls-certs\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.731169 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.731142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mk5h\" (UniqueName: \"kubernetes.io/projected/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kube-api-access-5mk5h\") pod \"precise-prefix-cache-test-kserve-6484944dcc-zxbwt\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.803726 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.803633    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:12.962374 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:12.962345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"]
Jul 08 07:08:12.963449 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:08:12.963422    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194bc9b0_ebdc_4571_bd05_1df8fc6d12a4.slice/crio-90bef904a51692c1c372aac32f2c86eebe0b4f12b8f272987b34272d1da0a57b WatchSource:0}: Error finding container 90bef904a51692c1c372aac32f2c86eebe0b4f12b8f272987b34272d1da0a57b: Status 404 returned error can't find the container with id 90bef904a51692c1c372aac32f2c86eebe0b4f12b8f272987b34272d1da0a57b
Jul 08 07:08:13.716276 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:13.716239    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" event={"ID":"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4","Type":"ContainerStarted","Data":"90bef904a51692c1c372aac32f2c86eebe0b4f12b8f272987b34272d1da0a57b"}
Jul 08 07:08:17.744781 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:17.744725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" event={"ID":"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4","Type":"ContainerStarted","Data":"cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c"}
Jul 08 07:08:20.769013 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:20.768978    2573 generic.go:356] "Generic (PLEG): container finished" podID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerID="cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c" exitCode=0
Jul 08 07:08:20.769013 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:20.769024    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" event={"ID":"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4","Type":"ContainerDied","Data":"cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c"}
Jul 08 07:08:22.780910 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:22.780871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" event={"ID":"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4","Type":"ContainerStarted","Data":"760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a"}
Jul 08 07:08:22.800300 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:22.800244    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" podStartSLOduration=2.744865205 podStartE2EDuration="10.80022929s" totalImagesPullingTime="4.815855517s" totalInitContainerRuntime="3.239508568s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:08:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:08:22.798059185 +0000 UTC m=+822.493580066" watchObservedRunningTime="2026-07-08 07:08:22.80022929 +0000 UTC m=+822.495750170"
Jul 08 07:08:22.804005 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:22.803977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:22.804104 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:22.804043    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:22.823248 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:22.823217    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:23.797994 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:23.797960    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:08:26.273157 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.273121    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"]
Jul 08 07:08:26.279915 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.279888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.282962 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.282937    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 08 07:08:26.285587 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.285565    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"]
Jul 08 07:08:26.348890 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.348854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.348890 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.348887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.349135 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.348979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.349135 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.349003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.349135 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.349033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4fh8\" (UniqueName: \"kubernetes.io/projected/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-kube-api-access-j4fh8\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.349252 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.349167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.450558 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.450521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.450558 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.450562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.450810 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.450579    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.450810 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.450612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.450810 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.450637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.450810 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.450666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4fh8\" (UniqueName: \"kubernetes.io/projected/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-kube-api-access-j4fh8\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.451043 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.451019    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.451180 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.451117    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.451270 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.451249    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.452976 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.452953    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.453117 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.453097    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.459071 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.459047    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4fh8\" (UniqueName: \"kubernetes.io/projected/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-kube-api-access-j4fh8\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.593363 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.593269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:26.732554 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.732395    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"]
Jul 08 07:08:26.735286 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:08:26.735258    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a55b3dc_87dd_4406_a54c_bf99a6dc8e00.slice/crio-d82f14181c8b25a93ec8cd5dddd1f9e6bbff5c4b9fbdb9bf6d6036aefdb201f2 WatchSource:0}: Error finding container d82f14181c8b25a93ec8cd5dddd1f9e6bbff5c4b9fbdb9bf6d6036aefdb201f2: Status 404 returned error can't find the container with id d82f14181c8b25a93ec8cd5dddd1f9e6bbff5c4b9fbdb9bf6d6036aefdb201f2
Jul 08 07:08:26.804474 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.804446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2" event={"ID":"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00","Type":"ContainerStarted","Data":"cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11"}
Jul 08 07:08:26.804590 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.804502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2" event={"ID":"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00","Type":"ContainerStarted","Data":"d82f14181c8b25a93ec8cd5dddd1f9e6bbff5c4b9fbdb9bf6d6036aefdb201f2"}
Jul 08 07:08:26.822314 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:26.822251    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2" podStartSLOduration=0.822231166 podStartE2EDuration="822.231166ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:08:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:08:26.820136083 +0000 UTC m=+826.515656988" watchObservedRunningTime="2026-07-08 07:08:26.822231166 +0000 UTC m=+826.517752047"
Jul 08 07:08:27.594024 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:27.593989    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:32.895674 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:32.895644    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"]
Jul 08 07:08:47.918683 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:47.918622    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2" podUID="8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" containerName="main" containerID="cri-o://cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11" gracePeriod=45
Jul 08 07:08:48.177806 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.177733    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:48.239318 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239287    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-home\") pod \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") "
Jul 08 07:08:48.239511 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239345    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-model-cache\") pod \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") "
Jul 08 07:08:48.239511 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239372    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4fh8\" (UniqueName: \"kubernetes.io/projected/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-kube-api-access-j4fh8\") pod \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") "
Jul 08 07:08:48.239511 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239416    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tmp-dir\") pod \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") "
Jul 08 07:08:48.239511 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239460    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tls-certs\") pod \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") "
Jul 08 07:08:48.239723 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239650    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-dshm\") pod \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\" (UID: \"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00\") "
Jul 08 07:08:48.239797 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239631    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" (UID: "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:08:48.239797 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239668    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-home" (OuterVolumeSpecName: "home") pod "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" (UID: "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:08:48.239797 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239708    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" (UID: "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:08:48.239993 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239968    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:08:48.239993 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.239991    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:08:48.240174 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.240003    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:08:48.241808 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.241778    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-dshm" (OuterVolumeSpecName: "dshm") pod "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" (UID: "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:08:48.241909 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.241780    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-kube-api-access-j4fh8" (OuterVolumeSpecName: "kube-api-access-j4fh8") pod "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" (UID: "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00"). InnerVolumeSpecName "kube-api-access-j4fh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:08:48.241909 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.241880    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" (UID: "8a55b3dc-87dd-4406-a54c-bf99a6dc8e00"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:08:48.340684 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.340647    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4fh8\" (UniqueName: \"kubernetes.io/projected/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-kube-api-access-j4fh8\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:08:48.340684 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.340677    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:08:48.340684 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.340686    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:08:48.932004 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.931971    2573 generic.go:356] "Generic (PLEG): container finished" podID="8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" containerID="cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11" exitCode=0
Jul 08 07:08:48.932439 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.932020    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"
Jul 08 07:08:48.932439 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.932063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2" event={"ID":"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00","Type":"ContainerDied","Data":"cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11"}
Jul 08 07:08:48.932439 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.932112    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2" event={"ID":"8a55b3dc-87dd-4406-a54c-bf99a6dc8e00","Type":"ContainerDied","Data":"d82f14181c8b25a93ec8cd5dddd1f9e6bbff5c4b9fbdb9bf6d6036aefdb201f2"}
Jul 08 07:08:48.932439 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.932136    2573 scope.go:117] "RemoveContainer" containerID="cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11"
Jul 08 07:08:48.941272 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.941254    2573 scope.go:117] "RemoveContainer" containerID="cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11"
Jul 08 07:08:48.941551 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:08:48.941531    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11\": container with ID starting with cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11 not found: ID does not exist" containerID="cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11"
Jul 08 07:08:48.941594 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.941560    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11"} err="failed to get container status \"cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11\": rpc error: code = NotFound desc = could not find container \"cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11\": container with ID starting with cce85cbaf9d364d6a50317c7d1ac0784c0e5d87210eee6aa5d92736ab22ccd11 not found: ID does not exist"
Jul 08 07:08:48.950090 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.950063    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"]
Jul 08 07:08:48.954243 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:48.954218    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bjmrz2"]
Jul 08 07:08:50.822010 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:08:50.821979    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" path="/var/lib/kubelet/pods/8a55b3dc-87dd-4406-a54c-bf99a6dc8e00/volumes"
Jul 08 07:09:26.307848 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:26.307802    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"]
Jul 08 07:09:41.333105 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.333062    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" podUID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerName="main" containerID="cri-o://760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a" gracePeriod=45
Jul 08 07:09:41.596511 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.596444    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:09:41.676455 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676414    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mk5h\" (UniqueName: \"kubernetes.io/projected/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kube-api-access-5mk5h\") pod \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") "
Jul 08 07:09:41.676662 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676479    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tmp-dir\") pod \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") "
Jul 08 07:09:41.676662 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676504    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-model-cache\") pod \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") "
Jul 08 07:09:41.676662 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-dshm\") pod \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") "
Jul 08 07:09:41.676662 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-home\") pod \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") "
Jul 08 07:09:41.676662 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676578    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kserve-provision-location\") pod \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") "
Jul 08 07:09:41.676662 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676593    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tls-certs\") pod \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\" (UID: \"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4\") "
Jul 08 07:09:41.677017 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676750    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-model-cache" (OuterVolumeSpecName: "model-cache") pod "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" (UID: "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:09:41.677017 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.676966    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" (UID: "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:09:41.677114 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.677040    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-home" (OuterVolumeSpecName: "home") pod "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" (UID: "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:09:41.678744 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.678717    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-dshm" (OuterVolumeSpecName: "dshm") pod "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" (UID: "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:09:41.678744 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.678731    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kube-api-access-5mk5h" (OuterVolumeSpecName: "kube-api-access-5mk5h") pod "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" (UID: "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4"). InnerVolumeSpecName "kube-api-access-5mk5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:09:41.678961 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.678755    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" (UID: "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:09:41.730621 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.730548    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" (UID: "194bc9b0-ebdc-4571-bd05-1df8fc6d12a4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:09:41.777280 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.777248    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mk5h\" (UniqueName: \"kubernetes.io/projected/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kube-api-access-5mk5h\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:09:41.777366 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.777284    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:09:41.777366 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.777300    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:09:41.777366 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.777308    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:09:41.777366 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.777317    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:09:41.777366 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.777325    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:09:41.777366 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:41.777333    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:09:42.229869 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.229830    2573 generic.go:356] "Generic (PLEG): container finished" podID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerID="760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a" exitCode=0
Jul 08 07:09:42.230039 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.229885    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"
Jul 08 07:09:42.230039 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.229897    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" event={"ID":"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4","Type":"ContainerDied","Data":"760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a"}
Jul 08 07:09:42.230039 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.229939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt" event={"ID":"194bc9b0-ebdc-4571-bd05-1df8fc6d12a4","Type":"ContainerDied","Data":"90bef904a51692c1c372aac32f2c86eebe0b4f12b8f272987b34272d1da0a57b"}
Jul 08 07:09:42.230039 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.229959    2573 scope.go:117] "RemoveContainer" containerID="760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a"
Jul 08 07:09:42.239368 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.239350    2573 scope.go:117] "RemoveContainer" containerID="cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c"
Jul 08 07:09:42.247360 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.247339    2573 scope.go:117] "RemoveContainer" containerID="760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a"
Jul 08 07:09:42.247589 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:09:42.247573    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a\": container with ID starting with 760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a not found: ID does not exist" containerID="760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a"
Jul 08 07:09:42.247636 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.247598    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a"} err="failed to get container status \"760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a\": rpc error: code = NotFound desc = could not find container \"760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a\": container with ID starting with 760016f749665bff69bd45b6ac7c83524ab7575825f6323cee595f1792c08b7a not found: ID does not exist"
Jul 08 07:09:42.247636 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.247616    2573 scope.go:117] "RemoveContainer" containerID="cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c"
Jul 08 07:09:42.247895 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:09:42.247880    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c\": container with ID starting with cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c not found: ID does not exist" containerID="cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c"
Jul 08 07:09:42.247950 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.247899    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c"} err="failed to get container status \"cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c\": rpc error: code = NotFound desc = could not find container \"cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c\": container with ID starting with cab443efdfdebcce6a3302adcfc15163d1d23b3a8e99dbf4ec967acb07ad662c not found: ID does not exist"
Jul 08 07:09:42.252128 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.252106    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"]
Jul 08 07:09:42.258053 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.258029    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6484944dcc-zxbwt"]
Jul 08 07:09:42.821277 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:09:42.821240    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" path="/var/lib/kubelet/pods/194bc9b0-ebdc-4571-bd05-1df8fc6d12a4/volumes"
Jul 08 07:10:06.216446 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.216407    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"]
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217007    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerName="main"
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217023    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerName="main"
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217038    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" containerName="main"
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217043    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" containerName="main"
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217049    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerName="storage-initializer"
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217054    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerName="storage-initializer"
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217133    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a55b3dc-87dd-4406-a54c-bf99a6dc8e00" containerName="main"
Jul 08 07:10:06.219030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.217142    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="194bc9b0-ebdc-4571-bd05-1df8fc6d12a4" containerName="main"
Jul 08 07:10:06.220135 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.220117    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.223824 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.223788    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-psjvw\""
Jul 08 07:10:06.223824 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.223805    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:10:06.223992 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.223849    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-bm6jh\""
Jul 08 07:10:06.223992 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.223862    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jul 08 07:10:06.223992 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.223793    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:10:06.230253 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.230230    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"]
Jul 08 07:10:06.285296 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.285255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km7mg\" (UniqueName: \"kubernetes.io/projected/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-kube-api-access-km7mg\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.285487 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.285373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.285487 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.285409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.386897 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.386863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.386897 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.386906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.387123 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.386957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km7mg\" (UniqueName: \"kubernetes.io/projected/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-kube-api-access-km7mg\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.387712 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.387668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.394987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.394957    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.396614 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.396591    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km7mg\" (UniqueName: \"kubernetes.io/projected/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-kube-api-access-km7mg\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.531558 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.531514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:06.668266 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.668240    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"]
Jul 08 07:10:06.669845 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:10:06.669817    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023b4b08_2936_4ed6_9e9e_9ef5c9e26a0b.slice/crio-16d5254d01830acded8e4b2364a80dad4974f168f10272d2a93ce71be9e565c3 WatchSource:0}: Error finding container 16d5254d01830acded8e4b2364a80dad4974f168f10272d2a93ce71be9e565c3: Status 404 returned error can't find the container with id 16d5254d01830acded8e4b2364a80dad4974f168f10272d2a93ce71be9e565c3
Jul 08 07:10:06.671814 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:06.671797    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 07:10:07.369846 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:07.369804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" event={"ID":"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b","Type":"ContainerStarted","Data":"16d5254d01830acded8e4b2364a80dad4974f168f10272d2a93ce71be9e565c3"}
Jul 08 07:10:08.376623 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:08.376586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" event={"ID":"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b","Type":"ContainerStarted","Data":"475334d41b1568056fead47c2ee65e29491a231c5b821fbe45c9c7bf0f6d74f9"}
Jul 08 07:10:08.377030 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:08.376701    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:08.393450 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:08.393401    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" podStartSLOduration=1.1499126610000001 podStartE2EDuration="2.393380351s" totalImagesPullingTime="1.24346769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:10:08.391192163 +0000 UTC m=+928.086713044" watchObservedRunningTime="2026-07-08 07:10:08.393380351 +0000 UTC m=+928.088901249"
Jul 08 07:10:39.383803 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:39.383748    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:40.416713 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.416680    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"]
Jul 08 07:10:40.425948 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:10:40.425913    2573 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 07:10:40.425948 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:10:40.425948 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:10:40.425948 ip-10-0-136-129 kubenswrapper[2573]:  > containerID="475334d41b1568056fead47c2ee65e29491a231c5b821fbe45c9c7bf0f6d74f9" cmd=["/bin/sleep","15"]
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.425967    2573 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" message="" err=<
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]:  >
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:10:40.425984    2573 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]:  > pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" podUID="023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" containerName="main" containerID="cri-o://475334d41b1568056fead47c2ee65e29491a231c5b821fbe45c9c7bf0f6d74f9"
Jul 08 07:10:40.426234 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.426027    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" podUID="023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" containerName="main" containerID="cri-o://475334d41b1568056fead47c2ee65e29491a231c5b821fbe45c9c7bf0f6d74f9" gracePeriod=60
Jul 08 07:10:40.550721 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.550693    2573 generic.go:356] "Generic (PLEG): container finished" podID="023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" containerID="475334d41b1568056fead47c2ee65e29491a231c5b821fbe45c9c7bf0f6d74f9" exitCode=0
Jul 08 07:10:40.550879 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.550783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" event={"ID":"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b","Type":"ContainerDied","Data":"475334d41b1568056fead47c2ee65e29491a231c5b821fbe45c9c7bf0f6d74f9"}
Jul 08 07:10:40.677303 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.677246    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:40.769930 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.769895    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tokenizer-uds\") pod \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") "
Jul 08 07:10:40.770094 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.769951    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km7mg\" (UniqueName: \"kubernetes.io/projected/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-kube-api-access-km7mg\") pod \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") "
Jul 08 07:10:40.770094 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.769997    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tls-certs\") pod \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\" (UID: \"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b\") "
Jul 08 07:10:40.770170 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.770142    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" (UID: "023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:10:40.772071 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.772039    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-kube-api-access-km7mg" (OuterVolumeSpecName: "kube-api-access-km7mg") pod "023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" (UID: "023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b"). InnerVolumeSpecName "kube-api-access-km7mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:10:40.772189 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.772128    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" (UID: "023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:10:40.871190 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.871152    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km7mg\" (UniqueName: \"kubernetes.io/projected/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-kube-api-access-km7mg\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:10:40.871190 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.871190    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:10:40.871449 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:40.871205    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b-tokenizer-uds\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:10:41.557912 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:41.557875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4" event={"ID":"023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b","Type":"ContainerDied","Data":"16d5254d01830acded8e4b2364a80dad4974f168f10272d2a93ce71be9e565c3"}
Jul 08 07:10:41.558328 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:41.557966    2573 scope.go:117] "RemoveContainer" containerID="475334d41b1568056fead47c2ee65e29491a231c5b821fbe45c9c7bf0f6d74f9"
Jul 08 07:10:41.558328 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:41.557888    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"
Jul 08 07:10:41.573530 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:41.573505    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"]
Jul 08 07:10:41.577266 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:41.577242    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schepj8z4"]
Jul 08 07:10:42.821721 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:10:42.821692    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" path="/var/lib/kubelet/pods/023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b/volumes"
Jul 08 07:11:07.919237 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.919036    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"]
Jul 08 07:11:07.928988 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.928955    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" containerName="main"
Jul 08 07:11:07.929274 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.929240    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" containerName="main"
Jul 08 07:11:07.930028 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.930006    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="023b4b08-2936-4ed6-9e9e-9ef5c9e26a0b" containerName="main"
Jul 08 07:11:07.934176 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.934150    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"]
Jul 08 07:11:07.934287 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.934245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:07.937603 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.937580    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-psjvw\""
Jul 08 07:11:07.937828 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.937806    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:11:07.937956 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.937870    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:11:07.937956 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.937659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-5b1e8f15-epp-sa-dockercfg-jrpzh\""
Jul 08 07:11:07.938063 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:07.938052    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Jul 08 07:11:08.000908 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.000873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840e8bc5-fef9-4648-b230-65efbdd0eda0-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.001103 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.000919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6znsb\" (UniqueName: \"kubernetes.io/projected/840e8bc5-fef9-4648-b230-65efbdd0eda0-kube-api-access-6znsb\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.001103 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.000953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/840e8bc5-fef9-4648-b230-65efbdd0eda0-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.101627 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.101590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6znsb\" (UniqueName: \"kubernetes.io/projected/840e8bc5-fef9-4648-b230-65efbdd0eda0-kube-api-access-6znsb\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.101884 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.101642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/840e8bc5-fef9-4648-b230-65efbdd0eda0-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.101884 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.101711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840e8bc5-fef9-4648-b230-65efbdd0eda0-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.102081 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.102059    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/840e8bc5-fef9-4648-b230-65efbdd0eda0-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.104192 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.104172    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840e8bc5-fef9-4648-b230-65efbdd0eda0-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.109629 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.109606    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6znsb\" (UniqueName: \"kubernetes.io/projected/840e8bc5-fef9-4648-b230-65efbdd0eda0-kube-api-access-6znsb\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.247080 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.247046    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.379694 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.379667    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"]
Jul 08 07:11:08.382980 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:11:08.382955    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840e8bc5_fef9_4648_b230_65efbdd0eda0.slice/crio-55a0450777f159c3635c6acd4c6e9bc2fb3fd03c3d34c4ffc30781963df19df0 WatchSource:0}: Error finding container 55a0450777f159c3635c6acd4c6e9bc2fb3fd03c3d34c4ffc30781963df19df0: Status 404 returned error can't find the container with id 55a0450777f159c3635c6acd4c6e9bc2fb3fd03c3d34c4ffc30781963df19df0
Jul 08 07:11:08.698794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.698667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" event={"ID":"840e8bc5-fef9-4648-b230-65efbdd0eda0","Type":"ContainerStarted","Data":"4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032"}
Jul 08 07:11:08.698794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.698721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" event={"ID":"840e8bc5-fef9-4648-b230-65efbdd0eda0","Type":"ContainerStarted","Data":"55a0450777f159c3635c6acd4c6e9bc2fb3fd03c3d34c4ffc30781963df19df0"}
Jul 08 07:11:08.698794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.698774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:08.716908 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:08.716854    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" podStartSLOduration=1.716837849 podStartE2EDuration="1.716837849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:11:08.715232172 +0000 UTC m=+988.410753053" watchObservedRunningTime="2026-07-08 07:11:08.716837849 +0000 UTC m=+988.412358731"
Jul 08 07:11:39.705499 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:39.705465    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:11:44.888099 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.888055    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"]
Jul 08 07:11:44.893011 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.892985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:44.895477 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.895450    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Jul 08 07:11:44.899748 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.899711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:44.899916 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.899758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:44.899916 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.899810    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:44.899916 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.899839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:44.899916 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.899863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:44.899916 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.899897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc77v\" (UniqueName: \"kubernetes.io/projected/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-kube-api-access-lc77v\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:44.900865 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:44.900593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"]
Jul 08 07:11:45.000704 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.000664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.000704 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.000705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.000983 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.000729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.000983 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.000750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.000983 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.000885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.000983 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.000932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc77v\" (UniqueName: \"kubernetes.io/projected/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-kube-api-access-lc77v\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.001186 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.001147    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.001251 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.001201    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.001359 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.001332    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.003133 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.003111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.003246 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.003230    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.009822 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.009792    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc77v\" (UniqueName: \"kubernetes.io/projected/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-kube-api-access-lc77v\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.205322 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.205217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:45.347292 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.347265    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"]
Jul 08 07:11:45.349515 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:11:45.349489    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3f1d4a_7caa_48f5_ae71_cfa325663b76.slice/crio-af3384ec3ee5c36db56bcb453b5483b32b5f2bb9ac2f7aabd7dc515c5d8a54a7 WatchSource:0}: Error finding container af3384ec3ee5c36db56bcb453b5483b32b5f2bb9ac2f7aabd7dc515c5d8a54a7: Status 404 returned error can't find the container with id af3384ec3ee5c36db56bcb453b5483b32b5f2bb9ac2f7aabd7dc515c5d8a54a7
Jul 08 07:11:45.901527 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.901494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw" event={"ID":"6b3f1d4a-7caa-48f5-ae71-cfa325663b76","Type":"ContainerStarted","Data":"6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5"}
Jul 08 07:11:45.901962 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.901547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw" event={"ID":"6b3f1d4a-7caa-48f5-ae71-cfa325663b76","Type":"ContainerStarted","Data":"af3384ec3ee5c36db56bcb453b5483b32b5f2bb9ac2f7aabd7dc515c5d8a54a7"}
Jul 08 07:11:45.924543 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:45.919554    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw" podStartSLOduration=1.919532641 podStartE2EDuration="1.919532641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:11:45.917521424 +0000 UTC m=+1025.613042309" watchObservedRunningTime="2026-07-08 07:11:45.919532641 +0000 UTC m=+1025.615053524"
Jul 08 07:11:46.205574 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:46.205460    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:55.205602 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:55.205554    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:55.218675 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:55.218635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:11:55.966943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:11:55.966912    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:12:34.495333 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:34.495256    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"]
Jul 08 07:12:49.520074 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.520018    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw" podUID="6b3f1d4a-7caa-48f5-ae71-cfa325663b76" containerName="main" containerID="cri-o://6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5" gracePeriod=45
Jul 08 07:12:49.784252 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.784178    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:12:49.870867 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.870827    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tmp-dir\") pod \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") "
Jul 08 07:12:49.871052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.870893    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc77v\" (UniqueName: \"kubernetes.io/projected/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-kube-api-access-lc77v\") pod \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") "
Jul 08 07:12:49.871052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.870925    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-dshm\") pod \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") "
Jul 08 07:12:49.871052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.870952    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tls-certs\") pod \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") "
Jul 08 07:12:49.871052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.870986    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-model-cache\") pod \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") "
Jul 08 07:12:49.871281 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.871076    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-home\") pod \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\" (UID: \"6b3f1d4a-7caa-48f5-ae71-cfa325663b76\") "
Jul 08 07:12:49.871281 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.871100    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b3f1d4a-7caa-48f5-ae71-cfa325663b76" (UID: "6b3f1d4a-7caa-48f5-ae71-cfa325663b76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:12:49.871281 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.871240    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b3f1d4a-7caa-48f5-ae71-cfa325663b76" (UID: "6b3f1d4a-7caa-48f5-ae71-cfa325663b76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:12:49.871455 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.871367    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:49.871455 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.871358    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-home" (OuterVolumeSpecName: "home") pod "6b3f1d4a-7caa-48f5-ae71-cfa325663b76" (UID: "6b3f1d4a-7caa-48f5-ae71-cfa325663b76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:12:49.871455 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.871378    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:49.873083 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.873054    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-kube-api-access-lc77v" (OuterVolumeSpecName: "kube-api-access-lc77v") pod "6b3f1d4a-7caa-48f5-ae71-cfa325663b76" (UID: "6b3f1d4a-7caa-48f5-ae71-cfa325663b76"). InnerVolumeSpecName "kube-api-access-lc77v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:12:49.873197 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.873089    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b3f1d4a-7caa-48f5-ae71-cfa325663b76" (UID: "6b3f1d4a-7caa-48f5-ae71-cfa325663b76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:12:49.873197 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.873097    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-dshm" (OuterVolumeSpecName: "dshm") pod "6b3f1d4a-7caa-48f5-ae71-cfa325663b76" (UID: "6b3f1d4a-7caa-48f5-ae71-cfa325663b76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:12:49.972794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.972716    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:49.972794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.972792    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:49.972794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.972802    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc77v\" (UniqueName: \"kubernetes.io/projected/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-kube-api-access-lc77v\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:49.972794 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:49.972811    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b3f1d4a-7caa-48f5-ae71-cfa325663b76-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:50.243508 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.243472    2573 generic.go:356] "Generic (PLEG): container finished" podID="6b3f1d4a-7caa-48f5-ae71-cfa325663b76" containerID="6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5" exitCode=0
Jul 08 07:12:50.243691 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.243520    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"
Jul 08 07:12:50.243691 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.243557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw" event={"ID":"6b3f1d4a-7caa-48f5-ae71-cfa325663b76","Type":"ContainerDied","Data":"6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5"}
Jul 08 07:12:50.243691 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.243619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw" event={"ID":"6b3f1d4a-7caa-48f5-ae71-cfa325663b76","Type":"ContainerDied","Data":"af3384ec3ee5c36db56bcb453b5483b32b5f2bb9ac2f7aabd7dc515c5d8a54a7"}
Jul 08 07:12:50.243691 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.243651    2573 scope.go:117] "RemoveContainer" containerID="6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5"
Jul 08 07:12:50.253390 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.253372    2573 scope.go:117] "RemoveContainer" containerID="6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5"
Jul 08 07:12:50.253674 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:12:50.253656    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5\": container with ID starting with 6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5 not found: ID does not exist" containerID="6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5"
Jul 08 07:12:50.253744 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.253687    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5"} err="failed to get container status \"6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5\": rpc error: code = NotFound desc = could not find container \"6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5\": container with ID starting with 6ecc6c405a80bccceeefb214d38b3413bdde3a29afc6e02dad735ca02f2e09e5 not found: ID does not exist"
Jul 08 07:12:50.326338 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.326308    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"]
Jul 08 07:12:50.332971 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.332947    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddx8zdw"]
Jul 08 07:12:50.821436 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:50.821396    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3f1d4a-7caa-48f5-ae71-cfa325663b76" path="/var/lib/kubelet/pods/6b3f1d4a-7caa-48f5-ae71-cfa325663b76/volumes"
Jul 08 07:12:53.654056 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:53.654023    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"]
Jul 08 07:12:53.664673 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:12:53.664633    2573 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 07:12:53.664673 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:12:53.664673 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:12:53.664673 ip-10-0-136-129 kubenswrapper[2573]:  > containerID="4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032" cmd=["/bin/sleep","15"]
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:53.664683    2573 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" message="" err=<
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]:  >
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:12:53.664698    2573 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]:  > pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" podUID="840e8bc5-fef9-4648-b230-65efbdd0eda0" containerName="main" containerID="cri-o://4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032"
Jul 08 07:12:53.665018 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:53.664745    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" podUID="840e8bc5-fef9-4648-b230-65efbdd0eda0" containerName="main" containerID="cri-o://4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032" gracePeriod=60
Jul 08 07:12:53.921078 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:53.921052    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:12:54.004033 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.003998    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6znsb\" (UniqueName: \"kubernetes.io/projected/840e8bc5-fef9-4648-b230-65efbdd0eda0-kube-api-access-6znsb\") pod \"840e8bc5-fef9-4648-b230-65efbdd0eda0\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") "
Jul 08 07:12:54.004033 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.004039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/840e8bc5-fef9-4648-b230-65efbdd0eda0-tokenizer-uds\") pod \"840e8bc5-fef9-4648-b230-65efbdd0eda0\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") "
Jul 08 07:12:54.004257 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.004092    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840e8bc5-fef9-4648-b230-65efbdd0eda0-tls-certs\") pod \"840e8bc5-fef9-4648-b230-65efbdd0eda0\" (UID: \"840e8bc5-fef9-4648-b230-65efbdd0eda0\") "
Jul 08 07:12:54.004375 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.004354    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840e8bc5-fef9-4648-b230-65efbdd0eda0-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "840e8bc5-fef9-4648-b230-65efbdd0eda0" (UID: "840e8bc5-fef9-4648-b230-65efbdd0eda0"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:12:54.006183 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.006145    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840e8bc5-fef9-4648-b230-65efbdd0eda0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "840e8bc5-fef9-4648-b230-65efbdd0eda0" (UID: "840e8bc5-fef9-4648-b230-65efbdd0eda0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:12:54.006280 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.006200    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840e8bc5-fef9-4648-b230-65efbdd0eda0-kube-api-access-6znsb" (OuterVolumeSpecName: "kube-api-access-6znsb") pod "840e8bc5-fef9-4648-b230-65efbdd0eda0" (UID: "840e8bc5-fef9-4648-b230-65efbdd0eda0"). InnerVolumeSpecName "kube-api-access-6znsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:12:54.104822 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.104757    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6znsb\" (UniqueName: \"kubernetes.io/projected/840e8bc5-fef9-4648-b230-65efbdd0eda0-kube-api-access-6znsb\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:54.104822 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.104812    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/840e8bc5-fef9-4648-b230-65efbdd0eda0-tokenizer-uds\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:54.104822 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.104824    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840e8bc5-fef9-4648-b230-65efbdd0eda0-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:12:54.274963 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.274923    2573 generic.go:356] "Generic (PLEG): container finished" podID="840e8bc5-fef9-4648-b230-65efbdd0eda0" containerID="4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032" exitCode=0
Jul 08 07:12:54.275148 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.274972    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"
Jul 08 07:12:54.275148 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.275000    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" event={"ID":"840e8bc5-fef9-4648-b230-65efbdd0eda0","Type":"ContainerDied","Data":"4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032"}
Jul 08 07:12:54.275148 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.275074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96" event={"ID":"840e8bc5-fef9-4648-b230-65efbdd0eda0","Type":"ContainerDied","Data":"55a0450777f159c3635c6acd4c6e9bc2fb3fd03c3d34c4ffc30781963df19df0"}
Jul 08 07:12:54.275148 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.275094    2573 scope.go:117] "RemoveContainer" containerID="4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032"
Jul 08 07:12:54.285154 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.285134    2573 scope.go:117] "RemoveContainer" containerID="4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032"
Jul 08 07:12:54.285444 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:12:54.285416    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032\": container with ID starting with 4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032 not found: ID does not exist" containerID="4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032"
Jul 08 07:12:54.285548 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.285448    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032"} err="failed to get container status \"4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032\": rpc error: code = NotFound desc = could not find container \"4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032\": container with ID starting with 4d9ff979e94b3950181f5275e9ff97942083008706ffddf4d461b053fa5f7032 not found: ID does not exist"
Jul 08 07:12:54.307505 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.307469    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"]
Jul 08 07:12:54.313697 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.313667    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schecqt96"]
Jul 08 07:12:54.822064 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:12:54.822028    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="840e8bc5-fef9-4648-b230-65efbdd0eda0" path="/var/lib/kubelet/pods/840e8bc5-fef9-4648-b230-65efbdd0eda0/volumes"
Jul 08 07:14:47.022493 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.022454    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"]
Jul 08 07:14:47.022952 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.022872    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840e8bc5-fef9-4648-b230-65efbdd0eda0" containerName="main"
Jul 08 07:14:47.022952 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.022885    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="840e8bc5-fef9-4648-b230-65efbdd0eda0" containerName="main"
Jul 08 07:14:47.022952 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.022895    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f1d4a-7caa-48f5-ae71-cfa325663b76" containerName="main"
Jul 08 07:14:47.022952 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.022904    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f1d4a-7caa-48f5-ae71-cfa325663b76" containerName="main"
Jul 08 07:14:47.023085 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.022980    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="840e8bc5-fef9-4648-b230-65efbdd0eda0" containerName="main"
Jul 08 07:14:47.023085 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.022992    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3f1d4a-7caa-48f5-ae71-cfa325663b76" containerName="main"
Jul 08 07:14:47.026130 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.026108    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.035878 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.035856    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-psjvw\""
Jul 08 07:14:47.036847 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.036830    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:14:47.038275 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.038259    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Jul 08 07:14:47.040272 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.040241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-qnl8w\""
Jul 08 07:14:47.046893 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.046872    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:14:47.057989 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.057949    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"]
Jul 08 07:14:47.161748 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.161699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aca73fa5-9043-4731-92f2-4c184133ed55-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.161983 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.161875    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/aca73fa5-9043-4731-92f2-4c184133ed55-tokenizer-uds\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.161983 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.161935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zr4z\" (UniqueName: \"kubernetes.io/projected/aca73fa5-9043-4731-92f2-4c184133ed55-kube-api-access-8zr4z\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.263158 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.263113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/aca73fa5-9043-4731-92f2-4c184133ed55-tokenizer-uds\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.263158 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.263158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zr4z\" (UniqueName: \"kubernetes.io/projected/aca73fa5-9043-4731-92f2-4c184133ed55-kube-api-access-8zr4z\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.263426 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.263212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aca73fa5-9043-4731-92f2-4c184133ed55-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.263536 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.263515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/aca73fa5-9043-4731-92f2-4c184133ed55-tokenizer-uds\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.265649 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.265614    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aca73fa5-9043-4731-92f2-4c184133ed55-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.278841 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.278752    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zr4z\" (UniqueName: \"kubernetes.io/projected/aca73fa5-9043-4731-92f2-4c184133ed55-kube-api-access-8zr4z\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.335910 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.335870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.496969 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.496938    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"]
Jul 08 07:14:47.497109 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:14:47.497046    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca73fa5_9043_4731_92f2_4c184133ed55.slice/crio-ccf4f4bbaa307aedf761832c22dee4f2167724ef869a7fbd781084bcfe773b0b WatchSource:0}: Error finding container ccf4f4bbaa307aedf761832c22dee4f2167724ef869a7fbd781084bcfe773b0b: Status 404 returned error can't find the container with id ccf4f4bbaa307aedf761832c22dee4f2167724ef869a7fbd781084bcfe773b0b
Jul 08 07:14:47.873295 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.873210    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" event={"ID":"aca73fa5-9043-4731-92f2-4c184133ed55","Type":"ContainerStarted","Data":"9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a"}
Jul 08 07:14:47.873295 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.873259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" event={"ID":"aca73fa5-9043-4731-92f2-4c184133ed55","Type":"ContainerStarted","Data":"ccf4f4bbaa307aedf761832c22dee4f2167724ef869a7fbd781084bcfe773b0b"}
Jul 08 07:14:47.873497 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.873322    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:14:47.907992 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:14:47.907936    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" podStartSLOduration=1.907920107 podStartE2EDuration="1.907920107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:14:47.904640571 +0000 UTC m=+1207.600161452" watchObservedRunningTime="2026-07-08 07:14:47.907920107 +0000 UTC m=+1207.603440988"
Jul 08 07:15:18.880630 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:18.880599    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:15:40.180239 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.180145    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"]
Jul 08 07:15:40.189725 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:15:40.189685    2573 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 07:15:40.189725 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:15:40.189725 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:15:40.189725 ip-10-0-136-129 kubenswrapper[2573]:  > containerID="9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a" cmd=["/bin/sleep","15"]
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.189750    2573 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" message="" err=<
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]:  >
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:15:40.189781    2573 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]:  > pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" podUID="aca73fa5-9043-4731-92f2-4c184133ed55" containerName="main" containerID="cri-o://9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a"
Jul 08 07:15:40.189999 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.189840    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" podUID="aca73fa5-9043-4731-92f2-4c184133ed55" containerName="main" containerID="cri-o://9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a" gracePeriod=60
Jul 08 07:15:40.458195 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.458167    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:15:40.510846 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.510817    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/aca73fa5-9043-4731-92f2-4c184133ed55-tokenizer-uds\") pod \"aca73fa5-9043-4731-92f2-4c184133ed55\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") "
Jul 08 07:15:40.511037 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.510858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zr4z\" (UniqueName: \"kubernetes.io/projected/aca73fa5-9043-4731-92f2-4c184133ed55-kube-api-access-8zr4z\") pod \"aca73fa5-9043-4731-92f2-4c184133ed55\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") "
Jul 08 07:15:40.511037 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.510882    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aca73fa5-9043-4731-92f2-4c184133ed55-tls-certs\") pod \"aca73fa5-9043-4731-92f2-4c184133ed55\" (UID: \"aca73fa5-9043-4731-92f2-4c184133ed55\") "
Jul 08 07:15:40.511152 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.511082    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca73fa5-9043-4731-92f2-4c184133ed55-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "aca73fa5-9043-4731-92f2-4c184133ed55" (UID: "aca73fa5-9043-4731-92f2-4c184133ed55"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:15:40.511228 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.511198    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/aca73fa5-9043-4731-92f2-4c184133ed55-tokenizer-uds\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:15:40.512915 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.512891    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aca73fa5-9043-4731-92f2-4c184133ed55-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aca73fa5-9043-4731-92f2-4c184133ed55" (UID: "aca73fa5-9043-4731-92f2-4c184133ed55"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:15:40.513006 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.512912    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca73fa5-9043-4731-92f2-4c184133ed55-kube-api-access-8zr4z" (OuterVolumeSpecName: "kube-api-access-8zr4z") pod "aca73fa5-9043-4731-92f2-4c184133ed55" (UID: "aca73fa5-9043-4731-92f2-4c184133ed55"). InnerVolumeSpecName "kube-api-access-8zr4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:15:40.611954 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.611914    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zr4z\" (UniqueName: \"kubernetes.io/projected/aca73fa5-9043-4731-92f2-4c184133ed55-kube-api-access-8zr4z\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:15:40.611954 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:40.611948    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aca73fa5-9043-4731-92f2-4c184133ed55-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:15:41.150052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.149951    2573 generic.go:356] "Generic (PLEG): container finished" podID="aca73fa5-9043-4731-92f2-4c184133ed55" containerID="9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a" exitCode=0
Jul 08 07:15:41.150052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.150019    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"
Jul 08 07:15:41.150052 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.150041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" event={"ID":"aca73fa5-9043-4731-92f2-4c184133ed55","Type":"ContainerDied","Data":"9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a"}
Jul 08 07:15:41.150394 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.150098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh" event={"ID":"aca73fa5-9043-4731-92f2-4c184133ed55","Type":"ContainerDied","Data":"ccf4f4bbaa307aedf761832c22dee4f2167724ef869a7fbd781084bcfe773b0b"}
Jul 08 07:15:41.150394 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.150120    2573 scope.go:117] "RemoveContainer" containerID="9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a"
Jul 08 07:15:41.159292 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.159273    2573 scope.go:117] "RemoveContainer" containerID="9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a"
Jul 08 07:15:41.159540 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:15:41.159524    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a\": container with ID starting with 9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a not found: ID does not exist" containerID="9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a"
Jul 08 07:15:41.159615 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.159549    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a"} err="failed to get container status \"9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a\": rpc error: code = NotFound desc = could not find container \"9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a\": container with ID starting with 9e53e789e3240afe228877a89e888cb46a7a1fda95499b39ed91a1c4813f3d0a not found: ID does not exist"
Jul 08 07:15:41.169712 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.169681    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"]
Jul 08 07:15:41.173866 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:41.173842    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-sche7kchh"]
Jul 08 07:15:42.821654 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:15:42.821621    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aca73fa5-9043-4731-92f2-4c184133ed55" path="/var/lib/kubelet/pods/aca73fa5-9043-4731-92f2-4c184133ed55/volumes"
Jul 08 07:18:18.377699 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.377660    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"]
Jul 08 07:18:18.378334 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.378208    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca73fa5-9043-4731-92f2-4c184133ed55" containerName="main"
Jul 08 07:18:18.378334 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.378231    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca73fa5-9043-4731-92f2-4c184133ed55" containerName="main"
Jul 08 07:18:18.378491 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.378354    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca73fa5-9043-4731-92f2-4c184133ed55" containerName="main"
Jul 08 07:18:18.381652 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.381634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.384029 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.384004    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:18:18.384154 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.384037    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:18:18.385119 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.385098    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs\""
Jul 08 07:18:18.385226 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.385181    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-psjvw\""
Jul 08 07:18:18.390299 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.390277    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"]
Jul 08 07:18:18.419220 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.419184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.419396 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.419232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.419396 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.419322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.419396 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.419342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bqm\" (UniqueName: \"kubernetes.io/projected/dbf4f562-6712-4622-9352-a6f05472543d-kube-api-access-l9bqm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.419396 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.419374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.419545 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.419420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf4f562-6712-4622-9352-a6f05472543d-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.520673 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.520629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.520673 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.520664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bqm\" (UniqueName: \"kubernetes.io/projected/dbf4f562-6712-4622-9352-a6f05472543d-kube-api-access-l9bqm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.520987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.520691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.520987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.520715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf4f562-6712-4622-9352-a6f05472543d-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.520987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.520787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.520987 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.520818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.521259 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.521162    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.521313 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.521251    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.521440 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.521417    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.523247 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.523217    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.523487 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.523456    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf4f562-6712-4622-9352-a6f05472543d-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.529368 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.529341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bqm\" (UniqueName: \"kubernetes.io/projected/dbf4f562-6712-4622-9352-a6f05472543d-kube-api-access-l9bqm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.693919 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.693827    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:18.828756 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:18.828734    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"]
Jul 08 07:18:18.831274 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:18:18.831245    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf4f562_6712_4622_9352_a6f05472543d.slice/crio-4066b2a10a6ec58735e3956325863d2d2ec4ba48e76d57bb670bcee41865fe7a WatchSource:0}: Error finding container 4066b2a10a6ec58735e3956325863d2d2ec4ba48e76d57bb670bcee41865fe7a: Status 404 returned error can't find the container with id 4066b2a10a6ec58735e3956325863d2d2ec4ba48e76d57bb670bcee41865fe7a
Jul 08 07:18:19.005363 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:19.005320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj" event={"ID":"dbf4f562-6712-4622-9352-a6f05472543d","Type":"ContainerStarted","Data":"5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846"}
Jul 08 07:18:19.005556 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:19.005425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj" event={"ID":"dbf4f562-6712-4622-9352-a6f05472543d","Type":"ContainerStarted","Data":"4066b2a10a6ec58735e3956325863d2d2ec4ba48e76d57bb670bcee41865fe7a"}
Jul 08 07:18:19.024977 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:19.024925    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj" podStartSLOduration=1.024907648 podStartE2EDuration="1.024907648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:18:19.022425626 +0000 UTC m=+1418.717946507" watchObservedRunningTime="2026-07-08 07:18:19.024907648 +0000 UTC m=+1418.720428529"
Jul 08 07:18:19.694473 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:19.694442    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:28.694141 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:28.694098    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:28.706888 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:28.706861    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:18:29.070386 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:18:29.070357    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:20:33.821051 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:33.821019    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"]
Jul 08 07:20:48.842657 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:48.842591    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj" podUID="dbf4f562-6712-4622-9352-a6f05472543d" containerName="main" containerID="cri-o://5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846" gracePeriod=45
Jul 08 07:20:49.097608 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.097549    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:20:49.219216 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219177    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-tmp-dir\") pod \"dbf4f562-6712-4622-9352-a6f05472543d\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") "
Jul 08 07:20:49.219216 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-home\") pod \"dbf4f562-6712-4622-9352-a6f05472543d\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") "
Jul 08 07:20:49.219448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-model-cache\") pod \"dbf4f562-6712-4622-9352-a6f05472543d\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") "
Jul 08 07:20:49.219448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf4f562-6712-4622-9352-a6f05472543d-tls-certs\") pod \"dbf4f562-6712-4622-9352-a6f05472543d\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") "
Jul 08 07:20:49.219448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9bqm\" (UniqueName: \"kubernetes.io/projected/dbf4f562-6712-4622-9352-a6f05472543d-kube-api-access-l9bqm\") pod \"dbf4f562-6712-4622-9352-a6f05472543d\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") "
Jul 08 07:20:49.219448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219352    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-dshm\") pod \"dbf4f562-6712-4622-9352-a6f05472543d\" (UID: \"dbf4f562-6712-4622-9352-a6f05472543d\") "
Jul 08 07:20:49.219667 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219504    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbf4f562-6712-4622-9352-a6f05472543d" (UID: "dbf4f562-6712-4622-9352-a6f05472543d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:20:49.219667 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219518    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-home" (OuterVolumeSpecName: "home") pod "dbf4f562-6712-4622-9352-a6f05472543d" (UID: "dbf4f562-6712-4622-9352-a6f05472543d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:20:49.219667 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219533    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbf4f562-6712-4622-9352-a6f05472543d" (UID: "dbf4f562-6712-4622-9352-a6f05472543d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:20:49.219667 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219611    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:20:49.219667 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219623    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:20:49.219667 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.219632    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:20:49.221515 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.221490    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbf4f562-6712-4622-9352-a6f05472543d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbf4f562-6712-4622-9352-a6f05472543d" (UID: "dbf4f562-6712-4622-9352-a6f05472543d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:20:49.221515 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.221502    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbf4f562-6712-4622-9352-a6f05472543d-kube-api-access-l9bqm" (OuterVolumeSpecName: "kube-api-access-l9bqm") pod "dbf4f562-6712-4622-9352-a6f05472543d" (UID: "dbf4f562-6712-4622-9352-a6f05472543d"). InnerVolumeSpecName "kube-api-access-l9bqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:20:49.221668 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.221513    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-dshm" (OuterVolumeSpecName: "dshm") pod "dbf4f562-6712-4622-9352-a6f05472543d" (UID: "dbf4f562-6712-4622-9352-a6f05472543d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:20:49.321066 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.321024    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbf4f562-6712-4622-9352-a6f05472543d-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:20:49.321066 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.321060    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf4f562-6712-4622-9352-a6f05472543d-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:20:49.321248 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.321075    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9bqm\" (UniqueName: \"kubernetes.io/projected/dbf4f562-6712-4622-9352-a6f05472543d-kube-api-access-l9bqm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:20:49.796245 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.796210    2573 generic.go:356] "Generic (PLEG): container finished" podID="dbf4f562-6712-4622-9352-a6f05472543d" containerID="5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846" exitCode=0
Jul 08 07:20:49.796448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.796256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj" event={"ID":"dbf4f562-6712-4622-9352-a6f05472543d","Type":"ContainerDied","Data":"5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846"}
Jul 08 07:20:49.796448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.796299    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj" event={"ID":"dbf4f562-6712-4622-9352-a6f05472543d","Type":"ContainerDied","Data":"4066b2a10a6ec58735e3956325863d2d2ec4ba48e76d57bb670bcee41865fe7a"}
Jul 08 07:20:49.796448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.796322    2573 scope.go:117] "RemoveContainer" containerID="5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846"
Jul 08 07:20:49.796448 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.796260    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"
Jul 08 07:20:49.805907 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.805889    2573 scope.go:117] "RemoveContainer" containerID="5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846"
Jul 08 07:20:49.806182 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:20:49.806160    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846\": container with ID starting with 5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846 not found: ID does not exist" containerID="5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846"
Jul 08 07:20:49.806234 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.806192    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846"} err="failed to get container status \"5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846\": rpc error: code = NotFound desc = could not find container \"5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846\": container with ID starting with 5e3cab8b91a2a90fc3a9f5e63cf45bb46963ae9e39ab86e12248ae6279bde846 not found: ID does not exist"
Jul 08 07:20:49.817561 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.817533    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"]
Jul 08 07:20:49.821912 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:49.821889    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj"]
Jul 08 07:20:50.060117 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:50.060018    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4x5fbj" podUID="dbf4f562-6712-4622-9352-a6f05472543d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/health\": context deadline exceeded"
Jul 08 07:20:50.821818 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:20:50.821789    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbf4f562-6712-4622-9352-a6f05472543d" path="/var/lib/kubelet/pods/dbf4f562-6712-4622-9352-a6f05472543d/volumes"
Jul 08 07:21:02.308826 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.308790    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"]
Jul 08 07:21:02.309188 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.309162    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbf4f562-6712-4622-9352-a6f05472543d" containerName="main"
Jul 08 07:21:02.309188 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.309173    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbf4f562-6712-4622-9352-a6f05472543d" containerName="main"
Jul 08 07:21:02.309264 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.309237    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbf4f562-6712-4622-9352-a6f05472543d" containerName="main"
Jul 08 07:21:02.313699 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.313681    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.318352 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.318325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:21:02.318947 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.318927    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:21:02.319343 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.319322    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:21:02.319518 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.319481    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs\""
Jul 08 07:21:02.319518 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.319485    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-psjvw\""
Jul 08 07:21:02.319661 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.319549    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa-dockercfg-skn5r\""
Jul 08 07:21:02.328203 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.328179    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"]
Jul 08 07:21:02.424713 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.424665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-tokenizer-uds\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.424943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.424789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-kserve-provision-location\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.424943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.424828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.424943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.424877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52b6r\" (UniqueName: \"kubernetes.io/projected/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-kube-api-access-52b6r\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.525321 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.525273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-tokenizer-uds\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.525547 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.525328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-kserve-provision-location\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.525547 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.525371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.525547 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.525425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52b6r\" (UniqueName: \"kubernetes.io/projected/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-kube-api-access-52b6r\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.525799 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.525745    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-tokenizer-uds\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.525881 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.525799    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-kserve-provision-location\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.527968 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.527949    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.534658 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.534632    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52b6r\" (UniqueName: \"kubernetes.io/projected/f5902ce4-f2d8-4f73-9f5f-7e3576c09c21-kube-api-access-52b6r\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl\" (UID: \"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.624038 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.623959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:02.768338 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.768307    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"]
Jul 08 07:21:02.771706 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:21:02.771681    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5902ce4_f2d8_4f73_9f5f_7e3576c09c21.slice/crio-4ca5fe897a4221376aeed28f1946d5fe9739416304ca12e516ba788d1f0377b1 WatchSource:0}: Error finding container 4ca5fe897a4221376aeed28f1946d5fe9739416304ca12e516ba788d1f0377b1: Status 404 returned error can't find the container with id 4ca5fe897a4221376aeed28f1946d5fe9739416304ca12e516ba788d1f0377b1
Jul 08 07:21:02.865390 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.865336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl" event={"ID":"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21","Type":"ContainerStarted","Data":"204b7baf0ba60749de99c2fbfb103ecb750fae5269b25b69dc8ad4e468c74581"}
Jul 08 07:21:02.865555 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:02.865404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl" event={"ID":"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21","Type":"ContainerStarted","Data":"4ca5fe897a4221376aeed28f1946d5fe9739416304ca12e516ba788d1f0377b1"}
Jul 08 07:21:03.871581 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:03.871492    2573 generic.go:356] "Generic (PLEG): container finished" podID="f5902ce4-f2d8-4f73-9f5f-7e3576c09c21" containerID="204b7baf0ba60749de99c2fbfb103ecb750fae5269b25b69dc8ad4e468c74581" exitCode=0
Jul 08 07:21:03.871943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:03.871585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl" event={"ID":"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21","Type":"ContainerDied","Data":"204b7baf0ba60749de99c2fbfb103ecb750fae5269b25b69dc8ad4e468c74581"}
Jul 08 07:21:04.878096 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:04.878059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl" event={"ID":"f5902ce4-f2d8-4f73-9f5f-7e3576c09c21","Type":"ContainerStarted","Data":"4aed5a5329fea04204c3a969f9b9ebc0639a48ccedbbc739da433231b32d7482"}
Jul 08 07:21:04.878469 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:04.878192    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:21:04.904103 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:04.904057    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl" podStartSLOduration=2.165863106 podStartE2EDuration="2.904044687s" totalImagesPullingTime="0s" totalInitContainerRuntime="738.181581ms" isStatefulPod=false podCreationTimestamp="2026-07-08 07:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:21:04.901857377 +0000 UTC m=+1584.597378259" watchObservedRunningTime="2026-07-08 07:21:04.904044687 +0000 UTC m=+1584.599565603"
Jul 08 07:21:35.885222 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:21:35.885143    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl"
Jul 08 07:37:33.844125 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.844088    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"]
Jul 08 07:37:33.847787 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.847742    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:33.851298 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.851276    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-59b9d263-epp-sa-dockercfg-5bc7r\""
Jul 08 07:37:33.851594 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.851276    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs\""
Jul 08 07:37:33.859157 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.859129    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"]
Jul 08 07:37:33.922346 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.922313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tokenizer-uds\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:33.922571 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.922390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkbzq\" (UniqueName: \"kubernetes.io/projected/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-kube-api-access-qkbzq\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:33.922571 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:33.922510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tls-certs\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.023294 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.023248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tokenizer-uds\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.023458 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.023307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkbzq\" (UniqueName: \"kubernetes.io/projected/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-kube-api-access-qkbzq\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.023458 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.023369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tls-certs\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.023700 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.023680    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tokenizer-uds\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.025852 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.025831    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tls-certs\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.032310 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.032282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkbzq\" (UniqueName: \"kubernetes.io/projected/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-kube-api-access-qkbzq\") pod \"llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") " pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.162239 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.162141    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:34.302116 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:34.302051    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"]
Jul 08 07:37:34.304293 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:37:34.304261    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a83fd4_789f_4eed_bd88_62dea9a5ec2d.slice/crio-11c5ca656944c20c9c270dec22d9d7ea73a491e2e6f2887fe424b72b23942175 WatchSource:0}: Error finding container 11c5ca656944c20c9c270dec22d9d7ea73a491e2e6f2887fe424b72b23942175: Status 404 returned error can't find the container with id 11c5ca656944c20c9c270dec22d9d7ea73a491e2e6f2887fe424b72b23942175
Jul 08 07:37:35.100901 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:35.100861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" event={"ID":"20a83fd4-789f-4eed-bd88-62dea9a5ec2d","Type":"ContainerStarted","Data":"c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458"}
Jul 08 07:37:35.101278 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:35.100914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" event={"ID":"20a83fd4-789f-4eed-bd88-62dea9a5ec2d","Type":"ContainerStarted","Data":"11c5ca656944c20c9c270dec22d9d7ea73a491e2e6f2887fe424b72b23942175"}
Jul 08 07:37:35.101278 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:35.100933    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:37:35.122473 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:37:35.122422    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" podStartSLOduration=2.122406163 podStartE2EDuration="2.122406163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 07:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:37:35.120204723 +0000 UTC m=+2574.815725622" watchObservedRunningTime="2026-07-08 07:37:35.122406163 +0000 UTC m=+2574.817927043"
Jul 08 07:38:06.109320 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:38:06.109129    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:38:08.347237 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:38:08.347208    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 07:38:08.354988 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:38:08.354957    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 07:47:57.408256 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.408215    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"]
Jul 08 07:47:57.421868 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:47:57.421813    2573 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 07:47:57.421868 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:47:57.421868 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:47:57.421868 ip-10-0-136-129 kubenswrapper[2573]:  > containerID="c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458" cmd=["/bin/sleep","15"]
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.422266    2573 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" message="" err=<
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]:  >
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:47:57.422301    2573 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:47:57.422301 ip-10-0-136-129 kubenswrapper[2573]:  > pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" podUID="20a83fd4-789f-4eed-bd88-62dea9a5ec2d" containerName="main" containerID="cri-o://c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458"
Jul 08 07:47:57.422845 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.422366    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" podUID="20a83fd4-789f-4eed-bd88-62dea9a5ec2d" containerName="main" containerID="cri-o://c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458" gracePeriod=60
Jul 08 07:47:57.685351 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.685319    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:47:57.762243 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.762211    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tls-certs\") pod \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") "
Jul 08 07:47:57.762419 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.762282    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkbzq\" (UniqueName: \"kubernetes.io/projected/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-kube-api-access-qkbzq\") pod \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") "
Jul 08 07:47:57.762419 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.762388    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tokenizer-uds\") pod \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\" (UID: \"20a83fd4-789f-4eed-bd88-62dea9a5ec2d\") "
Jul 08 07:47:57.762700 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.762663    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "20a83fd4-789f-4eed-bd88-62dea9a5ec2d" (UID: "20a83fd4-789f-4eed-bd88-62dea9a5ec2d"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:47:57.764342 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.764319    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-kube-api-access-qkbzq" (OuterVolumeSpecName: "kube-api-access-qkbzq") pod "20a83fd4-789f-4eed-bd88-62dea9a5ec2d" (UID: "20a83fd4-789f-4eed-bd88-62dea9a5ec2d"). InnerVolumeSpecName "kube-api-access-qkbzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:47:57.764435 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.764369    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "20a83fd4-789f-4eed-bd88-62dea9a5ec2d" (UID: "20a83fd4-789f-4eed-bd88-62dea9a5ec2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:47:57.863283 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.863247    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkbzq\" (UniqueName: \"kubernetes.io/projected/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-kube-api-access-qkbzq\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:47:57.863283 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.863276    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tokenizer-uds\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:47:57.863283 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:57.863286    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a83fd4-789f-4eed-bd88-62dea9a5ec2d-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:47:58.405535 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.405495    2573 generic.go:356] "Generic (PLEG): container finished" podID="20a83fd4-789f-4eed-bd88-62dea9a5ec2d" containerID="c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458" exitCode=0
Jul 08 07:47:58.405716 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.405541    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"
Jul 08 07:47:58.405716 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.405550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" event={"ID":"20a83fd4-789f-4eed-bd88-62dea9a5ec2d","Type":"ContainerDied","Data":"c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458"}
Jul 08 07:47:58.405716 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.405597    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b" event={"ID":"20a83fd4-789f-4eed-bd88-62dea9a5ec2d","Type":"ContainerDied","Data":"11c5ca656944c20c9c270dec22d9d7ea73a491e2e6f2887fe424b72b23942175"}
Jul 08 07:47:58.405716 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.405618    2573 scope.go:117] "RemoveContainer" containerID="c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458"
Jul 08 07:47:58.415871 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.415852    2573 scope.go:117] "RemoveContainer" containerID="c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458"
Jul 08 07:47:58.416199 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:47:58.416164    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458\": container with ID starting with c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458 not found: ID does not exist" containerID="c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458"
Jul 08 07:47:58.416249 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.416207    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458"} err="failed to get container status \"c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458\": rpc error: code = NotFound desc = could not find container \"c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458\": container with ID starting with c3fa071641daa5de6aee9be594dfc606fcf9a8d28aa4911b371b5b1f51387458 not found: ID does not exist"
Jul 08 07:47:58.428634 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.428601    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"]
Jul 08 07:47:58.432516 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.432489    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche9kt4b"]
Jul 08 07:47:58.822607 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:47:58.822569    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20a83fd4-789f-4eed-bd88-62dea9a5ec2d" path="/var/lib/kubelet/pods/20a83fd4-789f-4eed-bd88-62dea9a5ec2d/volumes"
Jul 08 07:48:41.010670 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.010589    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"]
Jul 08 07:48:41.011195 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.010986    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a83fd4-789f-4eed-bd88-62dea9a5ec2d" containerName="main"
Jul 08 07:48:41.011195 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.011000    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a83fd4-789f-4eed-bd88-62dea9a5ec2d" containerName="main"
Jul 08 07:48:41.011195 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.011060    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="20a83fd4-789f-4eed-bd88-62dea9a5ec2d" containerName="main"
Jul 08 07:48:41.014102 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.014083    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.017943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.017915    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs\""
Jul 08 07:48:41.017943 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.017925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-e8706282-epp-sa-dockercfg-hpwhx\""
Jul 08 07:48:41.027219 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.027194    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"]
Jul 08 07:48:41.037681 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.037650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780fa379-ad7f-464b-b4ba-2a202cc549d3-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.037904 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.037687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/780fa379-ad7f-464b-b4ba-2a202cc549d3-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.037904 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.037713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdhq5\" (UniqueName: \"kubernetes.io/projected/780fa379-ad7f-464b-b4ba-2a202cc549d3-kube-api-access-jdhq5\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.138664 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.138630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780fa379-ad7f-464b-b4ba-2a202cc549d3-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.138664 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.138673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/780fa379-ad7f-464b-b4ba-2a202cc549d3-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.138902 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.138692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdhq5\" (UniqueName: \"kubernetes.io/projected/780fa379-ad7f-464b-b4ba-2a202cc549d3-kube-api-access-jdhq5\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.139160 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.139135    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/780fa379-ad7f-464b-b4ba-2a202cc549d3-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.141271 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.141248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780fa379-ad7f-464b-b4ba-2a202cc549d3-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.149858 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.149834    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdhq5\" (UniqueName: \"kubernetes.io/projected/780fa379-ad7f-464b-b4ba-2a202cc549d3-kube-api-access-jdhq5\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.324991 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.324891    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.470180 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.470154    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"]
Jul 08 07:48:41.472092 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:48:41.472058    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780fa379_ad7f_464b_b4ba_2a202cc549d3.slice/crio-cf91818ba9a804fca4ec9b37f841546ed694a465ba53d1c29724136483bfa57e WatchSource:0}: Error finding container cf91818ba9a804fca4ec9b37f841546ed694a465ba53d1c29724136483bfa57e: Status 404 returned error can't find the container with id cf91818ba9a804fca4ec9b37f841546ed694a465ba53d1c29724136483bfa57e
Jul 08 07:48:41.637963 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.637866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" event={"ID":"780fa379-ad7f-464b-b4ba-2a202cc549d3","Type":"ContainerStarted","Data":"a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae"}
Jul 08 07:48:41.637963 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.637920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" event={"ID":"780fa379-ad7f-464b-b4ba-2a202cc549d3","Type":"ContainerStarted","Data":"cf91818ba9a804fca4ec9b37f841546ed694a465ba53d1c29724136483bfa57e"}
Jul 08 07:48:41.637963 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.637959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:48:41.660735 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:48:41.660679    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" podStartSLOduration=1.660660561 podStartE2EDuration="1.660660561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 07:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:48:41.658055189 +0000 UTC m=+3241.353576062" watchObservedRunningTime="2026-07-08 07:48:41.660660561 +0000 UTC m=+3241.356181442"
Jul 08 07:49:12.645079 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:49:12.645047    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:54:00.693744 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:00.693706    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"]
Jul 08 07:54:00.702867 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:54:00.702831    2573 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 07:54:00.702867 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:54:00.702867 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:54:00.702867 ip-10-0-136-129 kubenswrapper[2573]:  > containerID="a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae" cmd=["/bin/sleep","15"]
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:00.702886    2573 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" message="" err=<
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]:  >
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:54:00.702898    2573 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]:         , stdout: , stderr: , exit code -1
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]:  > pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" podUID="780fa379-ad7f-464b-b4ba-2a202cc549d3" containerName="main" containerID="cri-o://a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae"
Jul 08 07:54:00.703107 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:00.702932    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" podUID="780fa379-ad7f-464b-b4ba-2a202cc549d3" containerName="main" containerID="cri-o://a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae" gracePeriod=60
Jul 08 07:54:00.949035 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:00.948973    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:54:01.061481 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.061449    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/780fa379-ad7f-464b-b4ba-2a202cc549d3-tokenizer-uds\") pod \"780fa379-ad7f-464b-b4ba-2a202cc549d3\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") "
Jul 08 07:54:01.061668 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.061514    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780fa379-ad7f-464b-b4ba-2a202cc549d3-tls-certs\") pod \"780fa379-ad7f-464b-b4ba-2a202cc549d3\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") "
Jul 08 07:54:01.061668 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.061546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdhq5\" (UniqueName: \"kubernetes.io/projected/780fa379-ad7f-464b-b4ba-2a202cc549d3-kube-api-access-jdhq5\") pod \"780fa379-ad7f-464b-b4ba-2a202cc549d3\" (UID: \"780fa379-ad7f-464b-b4ba-2a202cc549d3\") "
Jul 08 07:54:01.061817 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.061790    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780fa379-ad7f-464b-b4ba-2a202cc549d3-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "780fa379-ad7f-464b-b4ba-2a202cc549d3" (UID: "780fa379-ad7f-464b-b4ba-2a202cc549d3"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:54:01.063712 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.063677    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780fa379-ad7f-464b-b4ba-2a202cc549d3-kube-api-access-jdhq5" (OuterVolumeSpecName: "kube-api-access-jdhq5") pod "780fa379-ad7f-464b-b4ba-2a202cc549d3" (UID: "780fa379-ad7f-464b-b4ba-2a202cc549d3"). InnerVolumeSpecName "kube-api-access-jdhq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:54:01.063862 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.063780    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780fa379-ad7f-464b-b4ba-2a202cc549d3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "780fa379-ad7f-464b-b4ba-2a202cc549d3" (UID: "780fa379-ad7f-464b-b4ba-2a202cc549d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:54:01.162928 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.162884    2573 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/780fa379-ad7f-464b-b4ba-2a202cc549d3-tokenizer-uds\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:54:01.162928 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.162920    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780fa379-ad7f-464b-b4ba-2a202cc549d3-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:54:01.162928 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.162933    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdhq5\" (UniqueName: \"kubernetes.io/projected/780fa379-ad7f-464b-b4ba-2a202cc549d3-kube-api-access-jdhq5\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 07:54:01.348489 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.348455    2573 generic.go:356] "Generic (PLEG): container finished" podID="780fa379-ad7f-464b-b4ba-2a202cc549d3" containerID="a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae" exitCode=0
Jul 08 07:54:01.348669 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.348511    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"
Jul 08 07:54:01.348669 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.348550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" event={"ID":"780fa379-ad7f-464b-b4ba-2a202cc549d3","Type":"ContainerDied","Data":"a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae"}
Jul 08 07:54:01.348669 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.348627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw" event={"ID":"780fa379-ad7f-464b-b4ba-2a202cc549d3","Type":"ContainerDied","Data":"cf91818ba9a804fca4ec9b37f841546ed694a465ba53d1c29724136483bfa57e"}
Jul 08 07:54:01.348669 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.348653    2573 scope.go:117] "RemoveContainer" containerID="a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae"
Jul 08 07:54:01.358732 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.358707    2573 scope.go:117] "RemoveContainer" containerID="a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae"
Jul 08 07:54:01.359086 ip-10-0-136-129 kubenswrapper[2573]: E0708 07:54:01.359063    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae\": container with ID starting with a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae not found: ID does not exist" containerID="a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae"
Jul 08 07:54:01.359177 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.359097    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae"} err="failed to get container status \"a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae\": rpc error: code = NotFound desc = could not find container \"a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae\": container with ID starting with a4266ae9825d4191e91c164d91be2304a53672b26e5c491ad37ccd6c069909ae not found: ID does not exist"
Jul 08 07:54:01.391135 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.391102    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"]
Jul 08 07:54:01.396187 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:01.396162    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schedgbhw"]
Jul 08 07:54:02.821141 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:02.821110    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780fa379-ad7f-464b-b4ba-2a202cc549d3" path="/var/lib/kubelet/pods/780fa379-ad7f-464b-b4ba-2a202cc549d3/volumes"
Jul 08 07:54:26.585226 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.585188    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"]
Jul 08 07:54:26.585694 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.585572    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780fa379-ad7f-464b-b4ba-2a202cc549d3" containerName="main"
Jul 08 07:54:26.585694 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.585584    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="780fa379-ad7f-464b-b4ba-2a202cc549d3" containerName="main"
Jul 08 07:54:26.585694 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.585655    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="780fa379-ad7f-464b-b4ba-2a202cc549d3" containerName="main"
Jul 08 07:54:26.588645 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.588630    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.594160 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.594135    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-2577e794-epp-sa-dockercfg-vc25d\""
Jul 08 07:54:26.594331 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.594180    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs\""
Jul 08 07:54:26.610685 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.610661    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"]
Jul 08 07:54:26.692290 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.692257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.692449 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.692298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdksh\" (UniqueName: \"kubernetes.io/projected/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-kube-api-access-rdksh\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.692449 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.692316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.793511 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.793470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdksh\" (UniqueName: \"kubernetes.io/projected/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-kube-api-access-rdksh\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.793511 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.793512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.793825 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.793588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.794054 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.794032    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.796105 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.796084    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.803847 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.803823    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdksh\" (UniqueName: \"kubernetes.io/projected/e303ae4c-c54e-4b1f-b3d5-ef3a1457c985-kube-api-access-rdksh\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz\" (UID: \"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:26.897627 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:26.897546    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:27.040254 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:27.040229    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"]
Jul 08 07:54:27.041909 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:54:27.041881    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode303ae4c_c54e_4b1f_b3d5_ef3a1457c985.slice/crio-1c85986d93f63948199240acd1bfe3bb98a7bd1b77e0b3ef6717da6700389207 WatchSource:0}: Error finding container 1c85986d93f63948199240acd1bfe3bb98a7bd1b77e0b3ef6717da6700389207: Status 404 returned error can't find the container with id 1c85986d93f63948199240acd1bfe3bb98a7bd1b77e0b3ef6717da6700389207
Jul 08 07:54:27.486051 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:27.486010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz" event={"ID":"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985","Type":"ContainerStarted","Data":"77ddc2a3e8071bf770667487649bcad7336a608e563154afdc96d143743a2cd5"}
Jul 08 07:54:27.486311 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:27.486182    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:54:27.486311 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:27.486222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz" event={"ID":"e303ae4c-c54e-4b1f-b3d5-ef3a1457c985","Type":"ContainerStarted","Data":"1c85986d93f63948199240acd1bfe3bb98a7bd1b77e0b3ef6717da6700389207"}
Jul 08 07:54:27.505152 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:27.505098    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz" podStartSLOduration=1.505081803 podStartE2EDuration="1.505081803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 07:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:54:27.503628278 +0000 UTC m=+3587.199149159" watchObservedRunningTime="2026-07-08 07:54:27.505081803 +0000 UTC m=+3587.200602727"
Jul 08 07:54:58.492905 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:54:58.492873    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz"
Jul 08 07:55:59.449781 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.449733    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"]
Jul 08 07:55:59.453302 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.453276    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.459114 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.459090    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-test-kserve-self-signed-certs\""
Jul 08 07:55:59.459417 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.459395    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-test-epp-sa-dockercfg-mwlxf\""
Jul 08 07:55:59.501230 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.501199    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"]
Jul 08 07:55:59.602296 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.602245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfbfa7a-932a-42cf-a283-e8a193a5a671-tokenizer-uds\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.602296 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.602293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67xld\" (UniqueName: \"kubernetes.io/projected/8bfbfa7a-932a-42cf-a283-e8a193a5a671-kube-api-access-67xld\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.602535 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.602362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfbfa7a-932a-42cf-a283-e8a193a5a671-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.602535 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.602421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8bfbfa7a-932a-42cf-a283-e8a193a5a671-kserve-provision-location\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.703629 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.703523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfbfa7a-932a-42cf-a283-e8a193a5a671-tokenizer-uds\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.703629 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.703577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67xld\" (UniqueName: \"kubernetes.io/projected/8bfbfa7a-932a-42cf-a283-e8a193a5a671-kube-api-access-67xld\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.703629 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.703616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfbfa7a-932a-42cf-a283-e8a193a5a671-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.704001 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.703642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8bfbfa7a-932a-42cf-a283-e8a193a5a671-kserve-provision-location\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.704075 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.704028    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfbfa7a-932a-42cf-a283-e8a193a5a671-tokenizer-uds\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.704132 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.704078    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8bfbfa7a-932a-42cf-a283-e8a193a5a671-kserve-provision-location\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.706085 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.706066    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfbfa7a-932a-42cf-a283-e8a193a5a671-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.714744 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.714719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67xld\" (UniqueName: \"kubernetes.io/projected/8bfbfa7a-932a-42cf-a283-e8a193a5a671-kube-api-access-67xld\") pod \"router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5\" (UID: \"8bfbfa7a-932a-42cf-a283-e8a193a5a671\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.762905 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.762871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:55:59.918573 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.918546    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"]
Jul 08 07:55:59.919418 ip-10-0-136-129 kubenswrapper[2573]: W0708 07:55:59.919382    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfbfa7a_932a_42cf_a283_e8a193a5a671.slice/crio-c073d34b8d1584de20283400010a535d301df8e449ab7fc0ed3058e4220b6e09 WatchSource:0}: Error finding container c073d34b8d1584de20283400010a535d301df8e449ab7fc0ed3058e4220b6e09: Status 404 returned error can't find the container with id c073d34b8d1584de20283400010a535d301df8e449ab7fc0ed3058e4220b6e09
Jul 08 07:55:59.924797 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.924754    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:55:59.983428 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:55:59.983401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5" event={"ID":"8bfbfa7a-932a-42cf-a283-e8a193a5a671","Type":"ContainerStarted","Data":"c073d34b8d1584de20283400010a535d301df8e449ab7fc0ed3058e4220b6e09"}
Jul 08 07:56:00.990918 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:56:00.990880    2573 generic.go:356] "Generic (PLEG): container finished" podID="8bfbfa7a-932a-42cf-a283-e8a193a5a671" containerID="06c6a2f4f3333c1aec3baf53f6525fe9a18d082756ed5ca194e204e0c139625f" exitCode=0
Jul 08 07:56:00.991345 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:56:00.990976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5" event={"ID":"8bfbfa7a-932a-42cf-a283-e8a193a5a671","Type":"ContainerDied","Data":"06c6a2f4f3333c1aec3baf53f6525fe9a18d082756ed5ca194e204e0c139625f"}
Jul 08 07:56:01.997884 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:56:01.997847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5" event={"ID":"8bfbfa7a-932a-42cf-a283-e8a193a5a671","Type":"ContainerStarted","Data":"6ae10eef43cd8d75e7c789c26525d019c4ac51d5032ef11f0ff673b0d140d4bb"}
Jul 08 07:56:01.998286 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:56:01.997982    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 07:56:02.035940 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:56:02.035884    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5" podStartSLOduration=2.251693895 podStartE2EDuration="3.035866833s" totalImagesPullingTime="0s" totalInitContainerRuntime="784.172938ms" isStatefulPod=false podCreationTimestamp="2026-07-08 07:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:56:02.034858662 +0000 UTC m=+3681.730379544" watchObservedRunningTime="2026-07-08 07:56:02.035866833 +0000 UTC m=+3681.731387713"
Jul 08 07:56:33.005540 ip-10-0-136-129 kubenswrapper[2573]: I0708 07:56:33.005510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5"
Jul 08 08:09:22.966117 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:09:22.966059    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:10:45.602327 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:10:45.602288    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:10:45.611034 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:10:45.610997    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:11:13.396406 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.396322    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"]
Jul 08 08:11:13.400273 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.400248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.403735 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.403712    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-dockercfg-bh5z5\""
Jul 08 08:11:13.403951 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.403938    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs\""
Jul 08 08:11:13.457088 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.457035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0850e6-4981-4378-82a8-0e30ba496b49-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.457309 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.457184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-dshm\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.457309 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.457225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qph9d\" (UniqueName: \"kubernetes.io/projected/af0850e6-4981-4378-82a8-0e30ba496b49-kube-api-access-qph9d\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.457309 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.457261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.457309 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.457286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-home\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.457552 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.457319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.457552 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.457397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.464659 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.464631    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"]
Jul 08 08:11:13.557920 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.557884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-dshm\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.557920 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.557923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qph9d\" (UniqueName: \"kubernetes.io/projected/af0850e6-4981-4378-82a8-0e30ba496b49-kube-api-access-qph9d\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558197 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.557948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558197 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.557969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-home\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558197 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.558022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558474 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.558434    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558474 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.558458    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-home\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558720 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.558515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558720 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.558630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0850e6-4981-4378-82a8-0e30ba496b49-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.558935 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.558826    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.559004 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.558936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.560726 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.560701    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-dshm\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.561359 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.561340    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0850e6-4981-4378-82a8-0e30ba496b49-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.571858 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.571836    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qph9d\" (UniqueName: \"kubernetes.io/projected/af0850e6-4981-4378-82a8-0e30ba496b49-kube-api-access-qph9d\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.710409 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.710313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:13.866006 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.865977    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"]
Jul 08 08:11:13.867594 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:11:13.867565    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0850e6_4981_4378_82a8_0e30ba496b49.slice/crio-9ee916bb66a68562a0ac75e598036a601b7b670768ffc1c36b039a1add0b2a47 WatchSource:0}: Error finding container 9ee916bb66a68562a0ac75e598036a601b7b670768ffc1c36b039a1add0b2a47: Status 404 returned error can't find the container with id 9ee916bb66a68562a0ac75e598036a601b7b670768ffc1c36b039a1add0b2a47
Jul 08 08:11:13.869572 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.869550    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 08:11:13.922241 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:13.922199    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerStarted","Data":"9ee916bb66a68562a0ac75e598036a601b7b670768ffc1c36b039a1add0b2a47"}
Jul 08 08:11:14.929611 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:14.929518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerStarted","Data":"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"}
Jul 08 08:11:14.930114 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:14.929640    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:11:14.933187 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:14.933166    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 08:11:15.940774 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:15.940729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerStarted","Data":"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"}
Jul 08 08:11:18.962847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:18.962813    2573 generic.go:356] "Generic (PLEG): container finished" podID="af0850e6-4981-4378-82a8-0e30ba496b49" containerID="c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc" exitCode=0
Jul 08 08:11:18.963317 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:18.962862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerDied","Data":"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"}
Jul 08 08:11:28.977048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:11:28.977008    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:12:05.294194 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:05.294152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerStarted","Data":"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"}
Jul 08 08:12:05.335653 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:05.335595    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podStartSLOduration=2.547389547 podStartE2EDuration="52.335575688s" totalImagesPullingTime="46.398138694s" totalInitContainerRuntime="3.390047447s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:11:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:12:05.334243616 +0000 UTC m=+4645.029764499" watchObservedRunningTime="2026-07-08 08:12:05.335575688 +0000 UTC m=+4645.031096570"
Jul 08 08:12:13.711439 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:13.711399    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:12:13.712031 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:13.711478    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:12:13.712112 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:13.712087    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:12:23.710823 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:23.710756    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:12:33.711623 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:33.711522    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:12:36.375065 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.375028    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"]
Jul 08 08:12:36.382068 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.382042    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.386085 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.386057    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
Jul 08 08:12:36.395995 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.395962    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"]
Jul 08 08:12:36.446350 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.446310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7kgx\" (UniqueName: \"kubernetes.io/projected/5497978b-d745-45bb-a6f2-a35df1b95363-kube-api-access-w7kgx\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.446518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.446366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-kserve-provision-location\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.446518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.446391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5497978b-d745-45bb-a6f2-a35df1b95363-tls-certs\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.446518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.446416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-home\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.446518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.446440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-tmp-dir\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.446518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.446462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-model-cache\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.446518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.446480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-dshm\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547132 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-model-cache\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547132 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-dshm\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547400 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7kgx\" (UniqueName: \"kubernetes.io/projected/5497978b-d745-45bb-a6f2-a35df1b95363-kube-api-access-w7kgx\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547400 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-kserve-provision-location\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547400 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5497978b-d745-45bb-a6f2-a35df1b95363-tls-certs\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547400 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-home\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547793 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547677    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-home\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547793 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547631    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-model-cache\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547793 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-tmp-dir\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.547793 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-kserve-provision-location\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.548062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.547965    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-tmp-dir\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.549859 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.549825    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-dshm\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.550136 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.550111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5497978b-d745-45bb-a6f2-a35df1b95363-tls-certs\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.556813 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.556787    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7kgx\" (UniqueName: \"kubernetes.io/projected/5497978b-d745-45bb-a6f2-a35df1b95363-kube-api-access-w7kgx\") pod \"stop-feature-test-kserve-7854d477c-mttmw\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.695085 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.694984    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:36.854433 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:36.854398    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"]
Jul 08 08:12:37.495531 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:37.495486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" event={"ID":"5497978b-d745-45bb-a6f2-a35df1b95363","Type":"ContainerStarted","Data":"e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482"}
Jul 08 08:12:37.495969 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:37.495588    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" event={"ID":"5497978b-d745-45bb-a6f2-a35df1b95363","Type":"ContainerStarted","Data":"cd87a0f4ac2cb85145310108cebacd0f8386fecbfa3aa99ceb3c1ea7713735fd"}
Jul 08 08:12:41.522545 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:41.522509    2573 generic.go:356] "Generic (PLEG): container finished" podID="5497978b-d745-45bb-a6f2-a35df1b95363" containerID="e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482" exitCode=0
Jul 08 08:12:41.523039 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:41.522556    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" event={"ID":"5497978b-d745-45bb-a6f2-a35df1b95363","Type":"ContainerDied","Data":"e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482"}
Jul 08 08:12:42.530995 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:42.530956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" event={"ID":"5497978b-d745-45bb-a6f2-a35df1b95363","Type":"ContainerStarted","Data":"e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9"}
Jul 08 08:12:42.564630 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:42.564567    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podStartSLOduration=2.921149454 podStartE2EDuration="6.564551685s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.643402231s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:12:42.559456836 +0000 UTC m=+4682.254977740" watchObservedRunningTime="2026-07-08 08:12:42.564551685 +0000 UTC m=+4682.260072566"
Jul 08 08:12:42.695168 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:42.695127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:43.711440 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:43.711396    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:12:46.695956 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:46.695910    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:12:46.697665 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:46.697627    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:12:53.711626 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:53.711576    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:12:56.695538 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:12:56.695483    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:13:03.711216 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:03.711172    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:13:06.695572 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:06.695529    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:13:13.711228 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:13.711177    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:13:16.696114 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:16.696068    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:13:23.710843 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:23.710792    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:13:26.696325 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:26.696275    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:13:33.711217 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:33.711165    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:13:36.696138 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:36.696093    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:13:43.711512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:43.711450    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:13:46.696094 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:46.696048    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:13:53.710982 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:53.710935    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:13:56.696241 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:13:56.696195    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:14:03.711334 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:03.711234    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8001/health\": dial tcp 10.133.0.53:8001: connect: connection refused"
Jul 08 08:14:06.695489 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:06.695448    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:14:13.721552 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:13.721521    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:14:13.740343 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:13.740310    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:14:16.696975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:16.696934    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:14:20.770619 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:20.770582    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"]
Jul 08 08:14:26.696334 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:26.696293    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:14:35.796073 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:35.796026    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main" containerID="cri-o://458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2" gracePeriod=45
Jul 08 08:14:36.631538 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:36.631507    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="llm-d-routing-sidecar" containerID="cri-o://1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659" gracePeriod=45
Jul 08 08:14:36.695518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:36.695462    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:14:36.909021 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:36.908991    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:14:37.000242 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000207    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-model-cache\") pod \"af0850e6-4981-4378-82a8-0e30ba496b49\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") "
Jul 08 08:14:37.000242 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000248    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0850e6-4981-4378-82a8-0e30ba496b49-tls-certs\") pod \"af0850e6-4981-4378-82a8-0e30ba496b49\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") "
Jul 08 08:14:37.000512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000271    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-tmp-dir\") pod \"af0850e6-4981-4378-82a8-0e30ba496b49\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") "
Jul 08 08:14:37.000512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000318    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-dshm\") pod \"af0850e6-4981-4378-82a8-0e30ba496b49\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") "
Jul 08 08:14:37.000512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000386    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qph9d\" (UniqueName: \"kubernetes.io/projected/af0850e6-4981-4378-82a8-0e30ba496b49-kube-api-access-qph9d\") pod \"af0850e6-4981-4378-82a8-0e30ba496b49\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") "
Jul 08 08:14:37.000512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-home\") pod \"af0850e6-4981-4378-82a8-0e30ba496b49\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") "
Jul 08 08:14:37.000512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-kserve-provision-location\") pod \"af0850e6-4981-4378-82a8-0e30ba496b49\" (UID: \"af0850e6-4981-4378-82a8-0e30ba496b49\") "
Jul 08 08:14:37.000802 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000597    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-model-cache" (OuterVolumeSpecName: "model-cache") pod "af0850e6-4981-4378-82a8-0e30ba496b49" (UID: "af0850e6-4981-4378-82a8-0e30ba496b49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:14:37.000866 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.000830    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:14:37.001448 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.001416    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-home" (OuterVolumeSpecName: "home") pod "af0850e6-4981-4378-82a8-0e30ba496b49" (UID: "af0850e6-4981-4378-82a8-0e30ba496b49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:14:37.002643 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.002612    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0850e6-4981-4378-82a8-0e30ba496b49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af0850e6-4981-4378-82a8-0e30ba496b49" (UID: "af0850e6-4981-4378-82a8-0e30ba496b49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:14:37.002747 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.002671    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-dshm" (OuterVolumeSpecName: "dshm") pod "af0850e6-4981-4378-82a8-0e30ba496b49" (UID: "af0850e6-4981-4378-82a8-0e30ba496b49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:14:37.003269 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.003244    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0850e6-4981-4378-82a8-0e30ba496b49-kube-api-access-qph9d" (OuterVolumeSpecName: "kube-api-access-qph9d") pod "af0850e6-4981-4378-82a8-0e30ba496b49" (UID: "af0850e6-4981-4378-82a8-0e30ba496b49"). InnerVolumeSpecName "kube-api-access-qph9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:14:37.018416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.018378    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af0850e6-4981-4378-82a8-0e30ba496b49" (UID: "af0850e6-4981-4378-82a8-0e30ba496b49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:14:37.062879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.062838    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "af0850e6-4981-4378-82a8-0e30ba496b49" (UID: "af0850e6-4981-4378-82a8-0e30ba496b49"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:14:37.101520 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.101485    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0850e6-4981-4378-82a8-0e30ba496b49-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:14:37.101520 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.101516    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:14:37.101520 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.101524    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:14:37.101796 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.101534    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qph9d\" (UniqueName: \"kubernetes.io/projected/af0850e6-4981-4378-82a8-0e30ba496b49-kube-api-access-qph9d\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:14:37.101796 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.101544    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:14:37.101796 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.101552    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/af0850e6-4981-4378-82a8-0e30ba496b49-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:14:37.273191 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.273151    2573 generic.go:356] "Generic (PLEG): container finished" podID="af0850e6-4981-4378-82a8-0e30ba496b49" containerID="458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2" exitCode=0
Jul 08 08:14:37.273191 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.273185    2573 generic.go:356] "Generic (PLEG): container finished" podID="af0850e6-4981-4378-82a8-0e30ba496b49" containerID="1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659" exitCode=0
Jul 08 08:14:37.273466 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.273202    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"
Jul 08 08:14:37.273466 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.273233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerDied","Data":"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"}
Jul 08 08:14:37.273466 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.273303    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerDied","Data":"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"}
Jul 08 08:14:37.273466 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.273332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv" event={"ID":"af0850e6-4981-4378-82a8-0e30ba496b49","Type":"ContainerDied","Data":"9ee916bb66a68562a0ac75e598036a601b7b670768ffc1c36b039a1add0b2a47"}
Jul 08 08:14:37.273466 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.273367    2573 scope.go:117] "RemoveContainer" containerID="458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"
Jul 08 08:14:37.283082 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.283060    2573 scope.go:117] "RemoveContainer" containerID="c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"
Jul 08 08:14:37.292478 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.292456    2573 scope.go:117] "RemoveContainer" containerID="1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"
Jul 08 08:14:37.300422 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.300391    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"]
Jul 08 08:14:37.303992 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.303960    2573 scope.go:117] "RemoveContainer" containerID="458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"
Jul 08 08:14:37.304348 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:14:37.304329    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2\": container with ID starting with 458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2 not found: ID does not exist" containerID="458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"
Jul 08 08:14:37.304449 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.304358    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"} err="failed to get container status \"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2\": rpc error: code = NotFound desc = could not find container \"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2\": container with ID starting with 458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2 not found: ID does not exist"
Jul 08 08:14:37.304449 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.304377    2573 scope.go:117] "RemoveContainer" containerID="c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"
Jul 08 08:14:37.304590 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:14:37.304571    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc\": container with ID starting with c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc not found: ID does not exist" containerID="c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"
Jul 08 08:14:37.304645 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.304599    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"} err="failed to get container status \"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc\": rpc error: code = NotFound desc = could not find container \"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc\": container with ID starting with c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc not found: ID does not exist"
Jul 08 08:14:37.304645 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.304621    2573 scope.go:117] "RemoveContainer" containerID="1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"
Jul 08 08:14:37.304877 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:14:37.304857    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659\": container with ID starting with 1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659 not found: ID does not exist" containerID="1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"
Jul 08 08:14:37.304986 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.304879    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"} err="failed to get container status \"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659\": rpc error: code = NotFound desc = could not find container \"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659\": container with ID starting with 1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659 not found: ID does not exist"
Jul 08 08:14:37.304986 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.304894    2573 scope.go:117] "RemoveContainer" containerID="458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"
Jul 08 08:14:37.305190 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.305162    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2"} err="failed to get container status \"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2\": rpc error: code = NotFound desc = could not find container \"458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2\": container with ID starting with 458a0cb20c4aaeff96848261fbb993a251422759bdf1ef83decbf66f9dc585f2 not found: ID does not exist"
Jul 08 08:14:37.305190 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.305190    2573 scope.go:117] "RemoveContainer" containerID="c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"
Jul 08 08:14:37.305498 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.305471    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc"} err="failed to get container status \"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc\": rpc error: code = NotFound desc = could not find container \"c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc\": container with ID starting with c9497fea404882af1de19c11f6e828dac316d0ffa44570127dcef45cb8f13ecc not found: ID does not exist"
Jul 08 08:14:37.305563 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.305502    2573 scope.go:117] "RemoveContainer" containerID="1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"
Jul 08 08:14:37.305733 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.305715    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659"} err="failed to get container status \"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659\": rpc error: code = NotFound desc = could not find container \"1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659\": container with ID starting with 1872410801b56b8daa5bda7a7a5dd7e96fcc4828b9acf475877997b982d40659 not found: ID does not exist"
Jul 08 08:14:37.306652 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:37.306636    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-698bf6c56cql6dv"]
Jul 08 08:14:38.822604 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:38.822569    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" path="/var/lib/kubelet/pods/af0850e6-4981-4378-82a8-0e30ba496b49/volumes"
Jul 08 08:14:46.706024 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:46.705991    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:14:46.713789 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:46.713744    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:14:57.458908 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.458875    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"]
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459296    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="storage-initializer"
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459310    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="storage-initializer"
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459319    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main"
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459328    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main"
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459365    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="llm-d-routing-sidecar"
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459374    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="llm-d-routing-sidecar"
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459461    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="llm-d-routing-sidecar"
Jul 08 08:14:57.459482 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.459475    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0850e6-4981-4378-82a8-0e30ba496b49" containerName="main"
Jul 08 08:14:57.464573 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.464549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.467629 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.467585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-kserve-dockercfg-fdpcv\""
Jul 08 08:14:57.468053 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.468030    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
Jul 08 08:14:57.485056 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.485028    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"]
Jul 08 08:14:57.488940 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.488919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"]
Jul 08 08:14:57.489075 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.489014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.509429 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.509404    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"]
Jul 08 08:14:57.596400 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-home\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.596400 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596394    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-model-cache\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-home\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgmm\" (UniqueName: \"kubernetes.io/projected/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kube-api-access-lpgmm\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-model-cache\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf9040-a39b-423a-8d40-9567ad72e73c-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tmp-dir\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-tmp-dir\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.596640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mqb\" (UniqueName: \"kubernetes.io/projected/a8bf9040-a39b-423a-8d40-9567ad72e73c-kube-api-access-w6mqb\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.596989 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-dshm\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.596989 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.596989 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.596989 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.596723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-dshm\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698023 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.697988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-dshm\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698210 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-home\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698210 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-model-cache\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698210 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-home\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698210 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698436 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgmm\" (UniqueName: \"kubernetes.io/projected/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kube-api-access-lpgmm\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698436 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-model-cache\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698436 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf9040-a39b-423a-8d40-9567ad72e73c-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698436 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tmp-dir\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698436 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-tmp-dir\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698436 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mqb\" (UniqueName: \"kubernetes.io/projected/a8bf9040-a39b-423a-8d40-9567ad72e73c-kube-api-access-w6mqb\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698436 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-dshm\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698458    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-home\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698495    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-home\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698507    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-model-cache\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698563    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698714    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-model-cache\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698756    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-tmp-dir\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698781    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tmp-dir\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.698820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.698813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.699363 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.699006    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.700674 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.700650    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-dshm\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.700858 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.700795    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-dshm\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.701176 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.701144    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf9040-a39b-423a-8d40-9567ad72e73c-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.701313 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.701214    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.709744 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.709674    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mqb\" (UniqueName: \"kubernetes.io/projected/a8bf9040-a39b-423a-8d40-9567ad72e73c-kube-api-access-w6mqb\") pod \"custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.710857 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.710836    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgmm\" (UniqueName: \"kubernetes.io/projected/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kube-api-access-lpgmm\") pod \"custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.776649 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.776613    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:57.800146 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.800116    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:14:57.958074 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.958043    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"]
Jul 08 08:14:57.960398 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:14:57.960329    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e9c99a_c179_4621_a3e5_a4150c2cbf0a.slice/crio-dbea571c26968f2e2a126a4b88c9ed156c0cddbcc63bcd0cc64fbfad47f3796f WatchSource:0}: Error finding container dbea571c26968f2e2a126a4b88c9ed156c0cddbcc63bcd0cc64fbfad47f3796f: Status 404 returned error can't find the container with id dbea571c26968f2e2a126a4b88c9ed156c0cddbcc63bcd0cc64fbfad47f3796f
Jul 08 08:14:57.974430 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:57.974407    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"]
Jul 08 08:14:57.976142 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:14:57.976119    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bf9040_a39b_423a_8d40_9567ad72e73c.slice/crio-a322b1b2e2595bb2562ea0746b98744e6079f297a25eeecb96cb9fd14667a21d WatchSource:0}: Error finding container a322b1b2e2595bb2562ea0746b98744e6079f297a25eeecb96cb9fd14667a21d: Status 404 returned error can't find the container with id a322b1b2e2595bb2562ea0746b98744e6079f297a25eeecb96cb9fd14667a21d
Jul 08 08:14:58.395800 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:58.395754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerStarted","Data":"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"}
Jul 08 08:14:58.396036 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:58.395829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerStarted","Data":"dbea571c26968f2e2a126a4b88c9ed156c0cddbcc63bcd0cc64fbfad47f3796f"}
Jul 08 08:14:58.396036 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:58.395953    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:14:58.397655 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:58.397626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" event={"ID":"a8bf9040-a39b-423a-8d40-9567ad72e73c","Type":"ContainerStarted","Data":"afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4"}
Jul 08 08:14:58.397814 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:58.397674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" event={"ID":"a8bf9040-a39b-423a-8d40-9567ad72e73c","Type":"ContainerStarted","Data":"a322b1b2e2595bb2562ea0746b98744e6079f297a25eeecb96cb9fd14667a21d"}
Jul 08 08:14:59.406131 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:14:59.406094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerStarted","Data":"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"}
Jul 08 08:15:02.427797 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:02.427699    2573 generic.go:356] "Generic (PLEG): container finished" podID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerID="a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f" exitCode=0
Jul 08 08:15:02.428268 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:02.427788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerDied","Data":"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"}
Jul 08 08:15:02.429469 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:02.429449    2573 generic.go:356] "Generic (PLEG): container finished" podID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerID="afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4" exitCode=0
Jul 08 08:15:02.429561 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:02.429516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" event={"ID":"a8bf9040-a39b-423a-8d40-9567ad72e73c","Type":"ContainerDied","Data":"afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4"}
Jul 08 08:15:03.437960 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:03.437926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerStarted","Data":"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"}
Jul 08 08:15:03.440100 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:03.440069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" event={"ID":"a8bf9040-a39b-423a-8d40-9567ad72e73c","Type":"ContainerStarted","Data":"2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a"}
Jul 08 08:15:03.465551 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:03.465485    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podStartSLOduration=2.915470323 podStartE2EDuration="6.465464437s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.549994114s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:15:03.463560672 +0000 UTC m=+4823.159081579" watchObservedRunningTime="2026-07-08 08:15:03.465464437 +0000 UTC m=+4823.160985320"
Jul 08 08:15:03.495143 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:03.495091    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podStartSLOduration=2.903494596 podStartE2EDuration="6.495076638s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.591582042s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:15:03.491929137 +0000 UTC m=+4823.187450018" watchObservedRunningTime="2026-07-08 08:15:03.495076638 +0000 UTC m=+4823.190597520"
Jul 08 08:15:07.777207 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:07.777155    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:15:07.777696 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:07.777234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:15:07.779050 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:07.779018    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:15:07.800622 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:07.800580    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:15:07.800858 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:07.800642    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:15:07.802409 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:07.802372    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:15:17.778156 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:17.778104    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:15:17.791914 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:17.791887    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:15:17.801372 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:17.801329    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:15:27.606916 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:27.603193    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"]
Jul 08 08:15:27.778051 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:27.778003    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:15:27.800553 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:27.800514    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:15:37.777698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:37.777586    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:15:37.801307 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:37.801259    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:15:42.649923 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:42.649877    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" containerID="cri-o://e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9" gracePeriod=45
Jul 08 08:15:42.706871 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:42.706815    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 08 08:15:43.462222 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.462190    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:15:43.554355 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.554306    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5497978b-d745-45bb-a6f2-a35df1b95363-tls-certs\") pod \"5497978b-d745-45bb-a6f2-a35df1b95363\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") "
Jul 08 08:15:43.554557 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.554385    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-kserve-provision-location\") pod \"5497978b-d745-45bb-a6f2-a35df1b95363\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") "
Jul 08 08:15:43.554557 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.554410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-home\") pod \"5497978b-d745-45bb-a6f2-a35df1b95363\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") "
Jul 08 08:15:43.554557 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.554438    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7kgx\" (UniqueName: \"kubernetes.io/projected/5497978b-d745-45bb-a6f2-a35df1b95363-kube-api-access-w7kgx\") pod \"5497978b-d745-45bb-a6f2-a35df1b95363\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") "
Jul 08 08:15:43.554557 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.554462    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-tmp-dir\") pod \"5497978b-d745-45bb-a6f2-a35df1b95363\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") "
Jul 08 08:15:43.554557 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.554492    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-dshm\") pod \"5497978b-d745-45bb-a6f2-a35df1b95363\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") "
Jul 08 08:15:43.554557 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.554557    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-model-cache\") pod \"5497978b-d745-45bb-a6f2-a35df1b95363\" (UID: \"5497978b-d745-45bb-a6f2-a35df1b95363\") "
Jul 08 08:15:43.555135 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.555076    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-model-cache" (OuterVolumeSpecName: "model-cache") pod "5497978b-d745-45bb-a6f2-a35df1b95363" (UID: "5497978b-d745-45bb-a6f2-a35df1b95363"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:15:43.555135 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.555088    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-home" (OuterVolumeSpecName: "home") pod "5497978b-d745-45bb-a6f2-a35df1b95363" (UID: "5497978b-d745-45bb-a6f2-a35df1b95363"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:15:43.557229 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.557190    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-dshm" (OuterVolumeSpecName: "dshm") pod "5497978b-d745-45bb-a6f2-a35df1b95363" (UID: "5497978b-d745-45bb-a6f2-a35df1b95363"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:15:43.557572 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.557545    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5497978b-d745-45bb-a6f2-a35df1b95363-kube-api-access-w7kgx" (OuterVolumeSpecName: "kube-api-access-w7kgx") pod "5497978b-d745-45bb-a6f2-a35df1b95363" (UID: "5497978b-d745-45bb-a6f2-a35df1b95363"). InnerVolumeSpecName "kube-api-access-w7kgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:15:43.557902 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.557881    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5497978b-d745-45bb-a6f2-a35df1b95363-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5497978b-d745-45bb-a6f2-a35df1b95363" (UID: "5497978b-d745-45bb-a6f2-a35df1b95363"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:15:43.571619 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.571578    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5497978b-d745-45bb-a6f2-a35df1b95363" (UID: "5497978b-d745-45bb-a6f2-a35df1b95363"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:15:43.621871 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.621828    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5497978b-d745-45bb-a6f2-a35df1b95363" (UID: "5497978b-d745-45bb-a6f2-a35df1b95363"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:15:43.655458 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.655412    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:15:43.655458 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.655455    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:15:43.655458 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.655467    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5497978b-d745-45bb-a6f2-a35df1b95363-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:15:43.655976 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.655475    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:15:43.655976 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.655484    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:15:43.655976 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.655495    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7kgx\" (UniqueName: \"kubernetes.io/projected/5497978b-d745-45bb-a6f2-a35df1b95363-kube-api-access-w7kgx\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:15:43.655976 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.655507    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5497978b-d745-45bb-a6f2-a35df1b95363-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:15:43.720590 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.720497    2573 generic.go:356] "Generic (PLEG): container finished" podID="5497978b-d745-45bb-a6f2-a35df1b95363" containerID="e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9" exitCode=0
Jul 08 08:15:43.720590 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.720557    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"
Jul 08 08:15:43.720590 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.720569    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" event={"ID":"5497978b-d745-45bb-a6f2-a35df1b95363","Type":"ContainerDied","Data":"e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9"}
Jul 08 08:15:43.720910 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.720640    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw" event={"ID":"5497978b-d745-45bb-a6f2-a35df1b95363","Type":"ContainerDied","Data":"cd87a0f4ac2cb85145310108cebacd0f8386fecbfa3aa99ceb3c1ea7713735fd"}
Jul 08 08:15:43.720910 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.720675    2573 scope.go:117] "RemoveContainer" containerID="e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9"
Jul 08 08:15:43.732702 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.732677    2573 scope.go:117] "RemoveContainer" containerID="e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482"
Jul 08 08:15:43.742998 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.742973    2573 scope.go:117] "RemoveContainer" containerID="e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9"
Jul 08 08:15:43.743516 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:15:43.743484    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9\": container with ID starting with e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9 not found: ID does not exist" containerID="e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9"
Jul 08 08:15:43.743651 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.743525    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9"} err="failed to get container status \"e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9\": rpc error: code = NotFound desc = could not find container \"e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9\": container with ID starting with e8a3e4d96546477391cfdf856c81cd6cde0bf361ee7f3d58c512f9a2fe8c8bc9 not found: ID does not exist"
Jul 08 08:15:43.743651 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.743551    2573 scope.go:117] "RemoveContainer" containerID="e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482"
Jul 08 08:15:43.743956 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:15:43.743933    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482\": container with ID starting with e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482 not found: ID does not exist" containerID="e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482"
Jul 08 08:15:43.744107 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.744076    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482"} err="failed to get container status \"e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482\": rpc error: code = NotFound desc = could not find container \"e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482\": container with ID starting with e1805cd7d692b16ce5ca62d36a2863635052a8ccd3ef7870ce5b4f5196741482 not found: ID does not exist"
Jul 08 08:15:43.746261 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.746232    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"]
Jul 08 08:15:43.749441 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:43.749418    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7854d477c-mttmw"]
Jul 08 08:15:44.822698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:44.822653    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" path="/var/lib/kubelet/pods/5497978b-d745-45bb-a6f2-a35df1b95363/volumes"
Jul 08 08:15:47.777116 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:47.777069    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:15:47.801133 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:47.801093    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:15:57.777682 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:57.777633    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:15:57.801275 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:15:57.801239    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:16:03.308175 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.308134    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"]
Jul 08 08:16:03.308661 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.308545    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="storage-initializer"
Jul 08 08:16:03.308661 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.308556    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="storage-initializer"
Jul 08 08:16:03.308661 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.308587    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main"
Jul 08 08:16:03.308661 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.308592    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main"
Jul 08 08:16:03.308661 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.308653    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5497978b-d745-45bb-a6f2-a35df1b95363" containerName="main"
Jul 08 08:16:03.314073 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.314050    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.317333 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.317197    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"lora-single-adapter-test-kserve-self-signed-certs\""
Jul 08 08:16:03.317500 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.317350    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 08:16:03.329997 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.329971    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"]
Jul 08 08:16:03.446597 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.446550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-dshm\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.446842 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.446674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a330b8c3-0489-4393-aece-9e3c639c8d99-tls-certs\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.446842 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.446737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-kserve-provision-location\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.446842 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.446808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a330b8c3-0489-4393-aece-9e3c639c8d99-cabundle-cert\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.447034 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.446893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbbp6\" (UniqueName: \"kubernetes.io/projected/a330b8c3-0489-4393-aece-9e3c639c8d99-kube-api-access-vbbp6\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.447034 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.446946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-home\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.447034 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.446986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-tmp-dir\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.447034 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.447018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-model-cache\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.547937 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.547892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-model-cache\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548123 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-dshm\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548123 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a330b8c3-0489-4393-aece-9e3c639c8d99-tls-certs\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548123 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-kserve-provision-location\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548274 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a330b8c3-0489-4393-aece-9e3c639c8d99-cabundle-cert\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548274 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbbp6\" (UniqueName: \"kubernetes.io/projected/a330b8c3-0489-4393-aece-9e3c639c8d99-kube-api-access-vbbp6\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548274 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-home\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548274 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-tmp-dir\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548490 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548355    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-model-cache\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548546 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548487    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-kserve-provision-location\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548619 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548560    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-tmp-dir\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.548733 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.548702    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-home\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.549158 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.549128    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a330b8c3-0489-4393-aece-9e3c639c8d99-cabundle-cert\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.550624 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.550596    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-dshm\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.550733 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.550638    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a330b8c3-0489-4393-aece-9e3c639c8d99-tls-certs\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.557462 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.557434    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbbp6\" (UniqueName: \"kubernetes.io/projected/a330b8c3-0489-4393-aece-9e3c639c8d99-kube-api-access-vbbp6\") pod \"lora-single-adapter-test-kserve-57677dd964-v2jb8\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.628926 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.628822    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:03.809428 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.809393    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"]
Jul 08 08:16:03.811676 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:16:03.811644    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda330b8c3_0489_4393_aece_9e3c639c8d99.slice/crio-3616d47b48b9d6ba03acf381de7e9f10977a81edf191c9134e3c913eb8c910f8 WatchSource:0}: Error finding container 3616d47b48b9d6ba03acf381de7e9f10977a81edf191c9134e3c913eb8c910f8: Status 404 returned error can't find the container with id 3616d47b48b9d6ba03acf381de7e9f10977a81edf191c9134e3c913eb8c910f8
Jul 08 08:16:03.861068 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:03.860972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" event={"ID":"a330b8c3-0489-4393-aece-9e3c639c8d99","Type":"ContainerStarted","Data":"3616d47b48b9d6ba03acf381de7e9f10977a81edf191c9134e3c913eb8c910f8"}
Jul 08 08:16:04.873855 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:04.873747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" event={"ID":"a330b8c3-0489-4393-aece-9e3c639c8d99","Type":"ContainerStarted","Data":"0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5"}
Jul 08 08:16:07.777651 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:07.777608    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:16:07.801326 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:07.801284    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:16:08.914489 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:08.914449    2573 generic.go:356] "Generic (PLEG): container finished" podID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerID="0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5" exitCode=0
Jul 08 08:16:08.914489 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:08.914483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" event={"ID":"a330b8c3-0489-4393-aece-9e3c639c8d99","Type":"ContainerDied","Data":"0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5"}
Jul 08 08:16:09.924776 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:09.924727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" event={"ID":"a330b8c3-0489-4393-aece-9e3c639c8d99","Type":"ContainerStarted","Data":"b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4"}
Jul 08 08:16:09.952063 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:09.951989    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podStartSLOduration=2.747270311 podStartE2EDuration="6.951963744s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.204693433s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:16:09.949138921 +0000 UTC m=+4889.644659803" watchObservedRunningTime="2026-07-08 08:16:09.951963744 +0000 UTC m=+4889.647484625"
Jul 08 08:16:10.629960 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:10.629924    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:13.629575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:13.629536    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:16:13.631690 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:13.631652    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:16:17.777086 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:17.777041    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:16:17.801217 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:17.801175    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:16:23.629423 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:23.629361    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:16:27.777860 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:27.777693    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:16:27.800546 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:27.800500    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:16:33.630302 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:33.630253    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:16:37.777832 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:37.777781    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:16:37.800559 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:37.800513    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:16:43.629928 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:43.629879    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:16:47.777640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:47.777584    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:16:47.800625 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:47.800576    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:16:53.630156 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:53.630101    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:16:57.777423 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:57.777359    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:16:57.800974 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:16:57.800919    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:17:03.629553 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:03.629457    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:17:07.777248 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:07.777189    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:17:07.800720 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:07.800685    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:17:13.629932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:13.629879    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:17:17.778455 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:17.777663    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:17:17.801306 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:17.801260    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:17:23.630314 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:23.630259    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 08 08:17:27.777448 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:27.777383    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:17:27.801410 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:27.801364    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:17:33.640287 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:33.640251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:17:33.648310 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:33.648281    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:17:37.777127 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:37.777081    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:17:37.801233 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:37.801193    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:17:47.777911 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:47.777784    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8001/health\": dial tcp 10.133.0.55:8001: connect: connection refused"
Jul 08 08:17:47.801515 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:47.801469    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": dial tcp 10.133.0.56:8000: connect: connection refused"
Jul 08 08:17:57.792601 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:57.792565    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:17:57.805823 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:57.805797    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:17:57.812146 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:57.812121    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:17:57.820566 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:17:57.820539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:18:07.207912 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:07.207880    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"]
Jul 08 08:18:07.213480 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:07.213450    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"]
Jul 08 08:18:22.236636 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:22.236557    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main" containerID="cri-o://2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a" gracePeriod=45
Jul 08 08:18:22.240221 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:22.240115    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main" containerID="cri-o://da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7" gracePeriod=45
Jul 08 08:18:23.368108 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.367988    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="llm-d-routing-sidecar" containerID="cri-o://8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0" gracePeriod=44
Jul 08 08:18:23.532918 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.532830    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:18:23.611310 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.611281    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6mqb\" (UniqueName: \"kubernetes.io/projected/a8bf9040-a39b-423a-8d40-9567ad72e73c-kube-api-access-w6mqb\") pod \"a8bf9040-a39b-423a-8d40-9567ad72e73c\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") "
Jul 08 08:18:23.611479 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.611384    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf9040-a39b-423a-8d40-9567ad72e73c-tls-certs\") pod \"a8bf9040-a39b-423a-8d40-9567ad72e73c\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") "
Jul 08 08:18:23.611479 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.611435    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-home\") pod \"a8bf9040-a39b-423a-8d40-9567ad72e73c\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") "
Jul 08 08:18:23.611479 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.611467    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-model-cache\") pod \"a8bf9040-a39b-423a-8d40-9567ad72e73c\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") "
Jul 08 08:18:23.611651 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.611504    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-tmp-dir\") pod \"a8bf9040-a39b-423a-8d40-9567ad72e73c\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") "
Jul 08 08:18:23.611651 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.611573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-dshm\") pod \"a8bf9040-a39b-423a-8d40-9567ad72e73c\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") "
Jul 08 08:18:23.611651 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.611598    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-kserve-provision-location\") pod \"a8bf9040-a39b-423a-8d40-9567ad72e73c\" (UID: \"a8bf9040-a39b-423a-8d40-9567ad72e73c\") "
Jul 08 08:18:23.612373 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.612331    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8bf9040-a39b-423a-8d40-9567ad72e73c" (UID: "a8bf9040-a39b-423a-8d40-9567ad72e73c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.612529 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.612501    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-home" (OuterVolumeSpecName: "home") pod "a8bf9040-a39b-423a-8d40-9567ad72e73c" (UID: "a8bf9040-a39b-423a-8d40-9567ad72e73c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.614073 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.614045    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bf9040-a39b-423a-8d40-9567ad72e73c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8bf9040-a39b-423a-8d40-9567ad72e73c" (UID: "a8bf9040-a39b-423a-8d40-9567ad72e73c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:18:23.614435 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.614395    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8bf9040-a39b-423a-8d40-9567ad72e73c-kube-api-access-w6mqb" (OuterVolumeSpecName: "kube-api-access-w6mqb") pod "a8bf9040-a39b-423a-8d40-9567ad72e73c" (UID: "a8bf9040-a39b-423a-8d40-9567ad72e73c"). InnerVolumeSpecName "kube-api-access-w6mqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:18:23.614751 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.614728    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-dshm" (OuterVolumeSpecName: "dshm") pod "a8bf9040-a39b-423a-8d40-9567ad72e73c" (UID: "a8bf9040-a39b-423a-8d40-9567ad72e73c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.636981 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.636906    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8bf9040-a39b-423a-8d40-9567ad72e73c" (UID: "a8bf9040-a39b-423a-8d40-9567ad72e73c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.658165 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.658073    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:18:23.701502 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.701467    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a8bf9040-a39b-423a-8d40-9567ad72e73c" (UID: "a8bf9040-a39b-423a-8d40-9567ad72e73c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.712733 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.712702    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpgmm\" (UniqueName: \"kubernetes.io/projected/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kube-api-access-lpgmm\") pod \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") "
Jul 08 08:18:23.712932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.712749    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-dshm\") pod \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") "
Jul 08 08:18:23.712932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.712806    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tls-certs\") pod \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") "
Jul 08 08:18:23.712932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.712843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-home\") pod \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") "
Jul 08 08:18:23.712932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.712878    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-model-cache\") pod \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") "
Jul 08 08:18:23.712932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.712916    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kserve-provision-location\") pod \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") "
Jul 08 08:18:23.713181 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.712937    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tmp-dir\") pod \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\" (UID: \"32e9c99a-c179-4621-a3e5-a4150c2cbf0a\") "
Jul 08 08:18:23.713181 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713155    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "32e9c99a-c179-4621-a3e5-a4150c2cbf0a" (UID: "32e9c99a-c179-4621-a3e5-a4150c2cbf0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.713266 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713245    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.713308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713262    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.713308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713277    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.713308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713290    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.713308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713303    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.713486 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713317    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8bf9040-a39b-423a-8d40-9567ad72e73c-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.713486 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713330    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6mqb\" (UniqueName: \"kubernetes.io/projected/a8bf9040-a39b-423a-8d40-9567ad72e73c-kube-api-access-w6mqb\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.713486 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.713343    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf9040-a39b-423a-8d40-9567ad72e73c-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.714347 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.714318    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-home" (OuterVolumeSpecName: "home") pod "32e9c99a-c179-4621-a3e5-a4150c2cbf0a" (UID: "32e9c99a-c179-4621-a3e5-a4150c2cbf0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.715386 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.715361    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kube-api-access-lpgmm" (OuterVolumeSpecName: "kube-api-access-lpgmm") pod "32e9c99a-c179-4621-a3e5-a4150c2cbf0a" (UID: "32e9c99a-c179-4621-a3e5-a4150c2cbf0a"). InnerVolumeSpecName "kube-api-access-lpgmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:18:23.715504 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.715430    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-dshm" (OuterVolumeSpecName: "dshm") pod "32e9c99a-c179-4621-a3e5-a4150c2cbf0a" (UID: "32e9c99a-c179-4621-a3e5-a4150c2cbf0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.715504 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.715439    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32e9c99a-c179-4621-a3e5-a4150c2cbf0a" (UID: "32e9c99a-c179-4621-a3e5-a4150c2cbf0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:18:23.733397 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.733337    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32e9c99a-c179-4621-a3e5-a4150c2cbf0a" (UID: "32e9c99a-c179-4621-a3e5-a4150c2cbf0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.790539 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.790436    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "32e9c99a-c179-4621-a3e5-a4150c2cbf0a" (UID: "32e9c99a-c179-4621-a3e5-a4150c2cbf0a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:23.812267 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.812227    2573 generic.go:356] "Generic (PLEG): container finished" podID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerID="da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7" exitCode=0
Jul 08 08:18:23.812267 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.812258    2573 generic.go:356] "Generic (PLEG): container finished" podID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerID="8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0" exitCode=0
Jul 08 08:18:23.812528 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.812291    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"
Jul 08 08:18:23.812528 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.812311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerDied","Data":"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"}
Jul 08 08:18:23.812528 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.812382    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerDied","Data":"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"}
Jul 08 08:18:23.812528 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.812410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6" event={"ID":"32e9c99a-c179-4621-a3e5-a4150c2cbf0a","Type":"ContainerDied","Data":"dbea571c26968f2e2a126a4b88c9ed156c0cddbcc63bcd0cc64fbfad47f3796f"}
Jul 08 08:18:23.812528 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.812437    2573 scope.go:117] "RemoveContainer" containerID="da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"
Jul 08 08:18:23.813876 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.813853    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpgmm\" (UniqueName: \"kubernetes.io/projected/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kube-api-access-lpgmm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.813975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.813880    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.813975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.813890    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.813975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.813902    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.813975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.813916    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.813975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.813928    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e9c99a-c179-4621-a3e5-a4150c2cbf0a-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:23.814240 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.814155    2573 generic.go:356] "Generic (PLEG): container finished" podID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerID="2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a" exitCode=0
Jul 08 08:18:23.814240 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.814179    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" event={"ID":"a8bf9040-a39b-423a-8d40-9567ad72e73c","Type":"ContainerDied","Data":"2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a"}
Jul 08 08:18:23.814240 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.814220    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"
Jul 08 08:18:23.814406 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.814242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg" event={"ID":"a8bf9040-a39b-423a-8d40-9567ad72e73c","Type":"ContainerDied","Data":"a322b1b2e2595bb2562ea0746b98744e6079f297a25eeecb96cb9fd14667a21d"}
Jul 08 08:18:23.823547 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.823425    2573 scope.go:117] "RemoveContainer" containerID="a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"
Jul 08 08:18:23.839322 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.839296    2573 scope.go:117] "RemoveContainer" containerID="8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"
Jul 08 08:18:23.854745 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.854712    2573 scope.go:117] "RemoveContainer" containerID="da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"
Jul 08 08:18:23.855226 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:18:23.855194    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7\": container with ID starting with da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7 not found: ID does not exist" containerID="da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"
Jul 08 08:18:23.855376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.855240    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"} err="failed to get container status \"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7\": rpc error: code = NotFound desc = could not find container \"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7\": container with ID starting with da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7 not found: ID does not exist"
Jul 08 08:18:23.855376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.855267    2573 scope.go:117] "RemoveContainer" containerID="a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"
Jul 08 08:18:23.855650 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:18:23.855623    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f\": container with ID starting with a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f not found: ID does not exist" containerID="a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"
Jul 08 08:18:23.855740 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.855661    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"} err="failed to get container status \"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f\": rpc error: code = NotFound desc = could not find container \"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f\": container with ID starting with a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f not found: ID does not exist"
Jul 08 08:18:23.855740 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.855685    2573 scope.go:117] "RemoveContainer" containerID="8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"
Jul 08 08:18:23.856023 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:18:23.855998    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0\": container with ID starting with 8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0 not found: ID does not exist" containerID="8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"
Jul 08 08:18:23.856107 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.856030    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"} err="failed to get container status \"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0\": rpc error: code = NotFound desc = could not find container \"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0\": container with ID starting with 8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0 not found: ID does not exist"
Jul 08 08:18:23.856107 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.856064    2573 scope.go:117] "RemoveContainer" containerID="da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"
Jul 08 08:18:23.856413 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.856383    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7"} err="failed to get container status \"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7\": rpc error: code = NotFound desc = could not find container \"da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7\": container with ID starting with da938ead6493c6d801a371ca1172ccddf0f461eb66d9678f4159e8f3b02e9bc7 not found: ID does not exist"
Jul 08 08:18:23.856510 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.856415    2573 scope.go:117] "RemoveContainer" containerID="a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"
Jul 08 08:18:23.856718 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.856693    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f"} err="failed to get container status \"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f\": rpc error: code = NotFound desc = could not find container \"a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f\": container with ID starting with a2dde53b5d2b9e28d95d4cb682cce6de3497ebcc08490ce601c97d320d246a2f not found: ID does not exist"
Jul 08 08:18:23.856841 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.856721    2573 scope.go:117] "RemoveContainer" containerID="8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"
Jul 08 08:18:23.857144 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.857107    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0"} err="failed to get container status \"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0\": rpc error: code = NotFound desc = could not find container \"8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0\": container with ID starting with 8166152a5e19599872462bd5f5ec0961f11092b3989b538f6fc38d4526bbeed0 not found: ID does not exist"
Jul 08 08:18:23.857268 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.857256    2573 scope.go:117] "RemoveContainer" containerID="2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a"
Jul 08 08:18:23.871888 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.871862    2573 scope.go:117] "RemoveContainer" containerID="afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4"
Jul 08 08:18:23.872639 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.872617    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"]
Jul 08 08:18:23.881419 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.881399    2573 scope.go:117] "RemoveContainer" containerID="2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a"
Jul 08 08:18:23.881699 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:18:23.881676    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a\": container with ID starting with 2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a not found: ID does not exist" containerID="2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a"
Jul 08 08:18:23.881805 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.881699    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a"} err="failed to get container status \"2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a\": rpc error: code = NotFound desc = could not find container \"2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a\": container with ID starting with 2dfe098d45fa35c8ed45f6cd34285f3cc901ede2385b5fee9bbd00a541b5b99a not found: ID does not exist"
Jul 08 08:18:23.881805 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.881719    2573 scope.go:117] "RemoveContainer" containerID="afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4"
Jul 08 08:18:23.881915 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.881848    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-69dd5bf7b8-spkk6"]
Jul 08 08:18:23.882040 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:18:23.882022    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4\": container with ID starting with afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4 not found: ID does not exist" containerID="afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4"
Jul 08 08:18:23.882082 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.882047    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4"} err="failed to get container status \"afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4\": rpc error: code = NotFound desc = could not find container \"afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4\": container with ID starting with afd99675b42ba444ce1926e88525301d1ddced14b3ee988b2dadf649ef66d9d4 not found: ID does not exist"
Jul 08 08:18:23.894739 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.894707    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"]
Jul 08 08:18:23.899117 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:23.899086    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-77b65c7fc7-bsfpg"]
Jul 08 08:18:24.824296 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:24.823843    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" path="/var/lib/kubelet/pods/32e9c99a-c179-4621-a3e5-a4150c2cbf0a/volumes"
Jul 08 08:18:24.824896 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:24.824606    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" path="/var/lib/kubelet/pods/a8bf9040-a39b-423a-8d40-9567ad72e73c/volumes"
Jul 08 08:18:26.965240 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:26.965200    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"]
Jul 08 08:18:41.989246 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:41.989200    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" containerID="cri-o://b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4" gracePeriod=45
Jul 08 08:18:42.683743 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.683720    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:18:42.790347 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-tmp-dir\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790347 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a330b8c3-0489-4393-aece-9e3c639c8d99-cabundle-cert\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790609 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790390    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbbp6\" (UniqueName: \"kubernetes.io/projected/a330b8c3-0489-4393-aece-9e3c639c8d99-kube-api-access-vbbp6\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790609 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790416    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-dshm\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790609 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790442    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a330b8c3-0489-4393-aece-9e3c639c8d99-tls-certs\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790609 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790480    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-home\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790609 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790507    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-model-cache\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790609 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790585    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-kserve-provision-location\") pod \"a330b8c3-0489-4393-aece-9e3c639c8d99\" (UID: \"a330b8c3-0489-4393-aece-9e3c639c8d99\") "
Jul 08 08:18:42.790975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790858    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-home" (OuterVolumeSpecName: "home") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:42.790975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790895    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-model-cache" (OuterVolumeSpecName: "model-cache") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:42.790975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.790914    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a330b8c3-0489-4393-aece-9e3c639c8d99-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 08:18:42.792810 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.792753    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a330b8c3-0489-4393-aece-9e3c639c8d99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:18:42.792939 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.792804    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-dshm" (OuterVolumeSpecName: "dshm") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:42.793013 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.792994    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a330b8c3-0489-4393-aece-9e3c639c8d99-kube-api-access-vbbp6" (OuterVolumeSpecName: "kube-api-access-vbbp6") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "kube-api-access-vbbp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:18:42.803578 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.803551    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:42.827470 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.827424    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a330b8c3-0489-4393-aece-9e3c639c8d99" (UID: "a330b8c3-0489-4393-aece-9e3c639c8d99"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:18:42.891585 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891545    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a330b8c3-0489-4393-aece-9e3c639c8d99-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.891585 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891576    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.891585 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891591    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.891879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891604    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.891879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891616    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.891879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891630    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a330b8c3-0489-4393-aece-9e3c639c8d99-cabundle-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.891879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891640    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbbp6\" (UniqueName: \"kubernetes.io/projected/a330b8c3-0489-4393-aece-9e3c639c8d99-kube-api-access-vbbp6\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.891879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.891650    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a330b8c3-0489-4393-aece-9e3c639c8d99-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:18:42.937686 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.937651    2573 generic.go:356] "Generic (PLEG): container finished" podID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerID="b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4" exitCode=0
Jul 08 08:18:42.937880 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.937699    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"
Jul 08 08:18:42.937880 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.937731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" event={"ID":"a330b8c3-0489-4393-aece-9e3c639c8d99","Type":"ContainerDied","Data":"b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4"}
Jul 08 08:18:42.937880 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.937812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" event={"ID":"a330b8c3-0489-4393-aece-9e3c639c8d99","Type":"ContainerDied","Data":"3616d47b48b9d6ba03acf381de7e9f10977a81edf191c9134e3c913eb8c910f8"}
Jul 08 08:18:42.937880 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.937837    2573 scope.go:117] "RemoveContainer" containerID="b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4"
Jul 08 08:18:42.947484 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.947467    2573 scope.go:117] "RemoveContainer" containerID="0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5"
Jul 08 08:18:42.956114 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.956090    2573 scope.go:117] "RemoveContainer" containerID="b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4"
Jul 08 08:18:42.956424 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:18:42.956401    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4\": container with ID starting with b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4 not found: ID does not exist" containerID="b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4"
Jul 08 08:18:42.956481 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.956434    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4"} err="failed to get container status \"b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4\": rpc error: code = NotFound desc = could not find container \"b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4\": container with ID starting with b74513ef29c6bd40c6888bc90bae8ab70e9ed9bcc5f815e04ffe5db7e9cac1a4 not found: ID does not exist"
Jul 08 08:18:42.956481 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.956461    2573 scope.go:117] "RemoveContainer" containerID="0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5"
Jul 08 08:18:42.956733 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:18:42.956716    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5\": container with ID starting with 0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5 not found: ID does not exist" containerID="0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5"
Jul 08 08:18:42.956807 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.956739    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5"} err="failed to get container status \"0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5\": rpc error: code = NotFound desc = could not find container \"0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5\": container with ID starting with 0f3d0aca3602d4b4b619f04d7d45a2015947262461e9d941a76e108ebc8503b5 not found: ID does not exist"
Jul 08 08:18:42.972022 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.971994    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"]
Jul 08 08:18:42.974278 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:42.974253    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8"]
Jul 08 08:18:43.641675 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:43.641628    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-57677dd964-v2jb8" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 08 08:18:44.821645 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:18:44.821604    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" path="/var/lib/kubelet/pods/a330b8c3-0489-4393-aece-9e3c639c8d99/volumes"
Jul 08 08:19:02.481317 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481275    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"]
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481707    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="llm-d-routing-sidecar"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481722    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="llm-d-routing-sidecar"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481739    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="storage-initializer"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481744    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="storage-initializer"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481754    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481777    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481788    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="storage-initializer"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481794    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="storage-initializer"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481804    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="storage-initializer"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481809    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="storage-initializer"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481816    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481822    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481827    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main"
Jul 08 08:19:02.481847 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481831    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main"
Jul 08 08:19:02.482587 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481919    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8bf9040-a39b-423a-8d40-9567ad72e73c" containerName="main"
Jul 08 08:19:02.482587 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481933    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="llm-d-routing-sidecar"
Jul 08 08:19:02.482587 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481941    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e9c99a-c179-4621-a3e5-a4150c2cbf0a" containerName="main"
Jul 08 08:19:02.482587 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.481948    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a330b8c3-0489-4393-aece-9e3c639c8d99" containerName="main"
Jul 08 08:19:02.487152 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.487131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.493384 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.493360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-kserve-self-signed-certs\""
Jul 08 08:19:02.493518 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.493407    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-kserve-dockercfg-vnl4j\""
Jul 08 08:19:02.525473 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.525434    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"]
Jul 08 08:19:02.529049 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.529029    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.557612 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.557586    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"]
Jul 08 08:19:02.576376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-home\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.576376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-dshm\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.576575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-model-cache\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.576575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-tmp-dir\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.576575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-model-cache\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.576575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-tls-certs\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.576575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576514    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82ptc\" (UniqueName: \"kubernetes.io/projected/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-kube-api-access-82ptc\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.576575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.576575 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576570    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-tmp-dir\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.576833 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-home\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.576833 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-dshm\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.576833 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x6ph\" (UniqueName: \"kubernetes.io/projected/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-kube-api-access-5x6ph\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.576833 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-tls-certs\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.576833 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.576704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.585835 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.585797    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"]
Jul 08 08:19:02.677215 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-tls-certs\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-home\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-dshm\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677318    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-model-cache\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677345    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-tmp-dir\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.677416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-model-cache\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.677416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677380    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-tls-certs\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.677837 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677723    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-home\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677837 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677808    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-model-cache\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.677837 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677814    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677834    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-tmp-dir\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.677975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82ptc\" (UniqueName: \"kubernetes.io/projected/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-kube-api-access-82ptc\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677870    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-model-cache\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.677975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-tmp-dir\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.677975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.677963    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-home\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.678285 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.678000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-dshm\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.678285 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.678036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x6ph\" (UniqueName: \"kubernetes.io/projected/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-kube-api-access-5x6ph\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.678285 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.678248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-tmp-dir\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.678285 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.678252    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.678471 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.678445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-home\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.679752 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.679729    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-dshm\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.680170 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.680152    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-dshm\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.680393 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.680373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-tls-certs\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.680457 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.680373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-tls-certs\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.710161 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.710125    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x6ph\" (UniqueName: \"kubernetes.io/projected/6a8bb147-65b6-4266-9e9e-e69ffc0d2c74-kube-api-access-5x6ph\") pod \"router-with-refs-pd-test-kserve-6978d748b8-9ssnf\" (UID: \"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.710346 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.710222    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82ptc\" (UniqueName: \"kubernetes.io/projected/9c57983a-88f5-4615-9e6b-8bafc4a48dfa-kube-api-access-82ptc\") pod \"router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng\" (UID: \"9c57983a-88f5-4615-9e6b-8bafc4a48dfa\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:02.797218 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.797179    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:02.839460 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:02.839421    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:03.005476 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:03.005435    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"]
Jul 08 08:19:03.007228 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:19:03.007201    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8bb147_65b6_4266_9e9e_e69ffc0d2c74.slice/crio-a13b59fbf8be5e35bb9c4d2e07844c8233b02e0f1fd99ac2048aedc299f7bf92 WatchSource:0}: Error finding container a13b59fbf8be5e35bb9c4d2e07844c8233b02e0f1fd99ac2048aedc299f7bf92: Status 404 returned error can't find the container with id a13b59fbf8be5e35bb9c4d2e07844c8233b02e0f1fd99ac2048aedc299f7bf92
Jul 08 08:19:03.039401 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:03.039374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"]
Jul 08 08:19:03.042117 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:19:03.042088    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c57983a_88f5_4615_9e6b_8bafc4a48dfa.slice/crio-a41eabf09fd38908230afa5d95e67d64d5fb48f09b3b31cf452e24811e51cf20 WatchSource:0}: Error finding container a41eabf09fd38908230afa5d95e67d64d5fb48f09b3b31cf452e24811e51cf20: Status 404 returned error can't find the container with id a41eabf09fd38908230afa5d95e67d64d5fb48f09b3b31cf452e24811e51cf20
Jul 08 08:19:03.046240 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:03.046214    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" event={"ID":"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74","Type":"ContainerStarted","Data":"a13b59fbf8be5e35bb9c4d2e07844c8233b02e0f1fd99ac2048aedc299f7bf92"}
Jul 08 08:19:04.056292 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:04.056251    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" event={"ID":"9c57983a-88f5-4615-9e6b-8bafc4a48dfa","Type":"ContainerStarted","Data":"651c0c4dce5c3fe6951ae3b19c10556363eeba9c8ce6cc8ca176cec5abbe4c02"}
Jul 08 08:19:04.057446 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:04.056319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" event={"ID":"9c57983a-88f5-4615-9e6b-8bafc4a48dfa","Type":"ContainerStarted","Data":"a41eabf09fd38908230afa5d95e67d64d5fb48f09b3b31cf452e24811e51cf20"}
Jul 08 08:19:04.058369 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:04.058319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" event={"ID":"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74","Type":"ContainerStarted","Data":"81ab1a7b1b02a7ff4762d704accc044c6f81402d8238b9ddb91e712b7bffab69"}
Jul 08 08:19:04.058509 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:04.058439    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:05.068711 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:05.068665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" event={"ID":"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74","Type":"ContainerStarted","Data":"001fed2ab22b916716fe3a627dafffc9d95bdb6ffbaee6e88fe8a7e8a3b37316"}
Jul 08 08:19:07.095206 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:07.095104    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerID="651c0c4dce5c3fe6951ae3b19c10556363eeba9c8ce6cc8ca176cec5abbe4c02" exitCode=0
Jul 08 08:19:07.095206 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:07.095187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" event={"ID":"9c57983a-88f5-4615-9e6b-8bafc4a48dfa","Type":"ContainerDied","Data":"651c0c4dce5c3fe6951ae3b19c10556363eeba9c8ce6cc8ca176cec5abbe4c02"}
Jul 08 08:19:08.102800 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:08.102697    2573 generic.go:356] "Generic (PLEG): container finished" podID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerID="001fed2ab22b916716fe3a627dafffc9d95bdb6ffbaee6e88fe8a7e8a3b37316" exitCode=0
Jul 08 08:19:08.102800 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:08.102780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" event={"ID":"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74","Type":"ContainerDied","Data":"001fed2ab22b916716fe3a627dafffc9d95bdb6ffbaee6e88fe8a7e8a3b37316"}
Jul 08 08:19:08.104964 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:08.104941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" event={"ID":"9c57983a-88f5-4615-9e6b-8bafc4a48dfa","Type":"ContainerStarted","Data":"2931b47c3713ae15299afbf496c6bf0d53c43a3284aac9a9d85cb5cda4f7c376"}
Jul 08 08:19:08.158194 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:08.158137    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podStartSLOduration=2.447761963 podStartE2EDuration="6.158116094s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.710354131s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:19:08.155825127 +0000 UTC m=+5067.851346204" watchObservedRunningTime="2026-07-08 08:19:08.158116094 +0000 UTC m=+5067.853636976"
Jul 08 08:19:09.113932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:09.113890    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" event={"ID":"6a8bb147-65b6-4266-9e9e-e69ffc0d2c74","Type":"ContainerStarted","Data":"ae20dccd51b3425d9b14010c020209cd04fb075f4429fa3a6549c130f6766f23"}
Jul 08 08:19:09.142481 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:09.142411    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podStartSLOduration=3.444857393 podStartE2EDuration="7.142387576s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.697530183s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:19:09.140601876 +0000 UTC m=+5068.836122757" watchObservedRunningTime="2026-07-08 08:19:09.142387576 +0000 UTC m=+5068.837908463"
Jul 08 08:19:12.797912 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:12.797868    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:12.798509 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:12.797949    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:12.799375 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:12.799339    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:19:12.840545 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:12.840496    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:12.840746 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:12.840566    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:19:12.842094 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:12.842059    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:19:22.798980 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:22.798459    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:19:22.824421 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:22.824391    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:19:22.840633 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:22.840594    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:19:25.298296 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.298254    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"]
Jul 08 08:19:25.302517 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.302492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.305991 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.305971    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 08:19:25.306776 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.306738    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"lora-multiple-adapters-test-kserve-self-signed-certs\""
Jul 08 08:19:25.316751 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.316721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"]
Jul 08 08:19:25.409717 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.409673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-dshm\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.409947 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.409831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/519fc1c9-d38e-404f-9694-4683deeedf51-cabundle-cert\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.409947 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.409873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-model-cache\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.409947 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.409901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-kserve-provision-location\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.410069 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.409950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpmlg\" (UniqueName: \"kubernetes.io/projected/519fc1c9-d38e-404f-9694-4683deeedf51-kube-api-access-kpmlg\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.410069 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.409989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-tmp-dir\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.410069 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.410040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-home\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.410069 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.410064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/519fc1c9-d38e-404f-9694-4683deeedf51-tls-certs\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.510682 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.510627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-home\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.510884 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.510697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/519fc1c9-d38e-404f-9694-4683deeedf51-tls-certs\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.510884 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.510793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-dshm\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511004 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.510859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/519fc1c9-d38e-404f-9694-4683deeedf51-cabundle-cert\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511004 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.510918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-model-cache\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511004 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.510949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-kserve-provision-location\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511165 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.511107    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-home\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511233 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.511173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpmlg\" (UniqueName: \"kubernetes.io/projected/519fc1c9-d38e-404f-9694-4683deeedf51-kube-api-access-kpmlg\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511233 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.511209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-tmp-dir\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511347 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.511245    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-model-cache\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511480 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.511447    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-kserve-provision-location\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511588 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.511542    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-tmp-dir\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.511756 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.511728    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/519fc1c9-d38e-404f-9694-4683deeedf51-cabundle-cert\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.513098 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.513079    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-dshm\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.514089 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.514069    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/519fc1c9-d38e-404f-9694-4683deeedf51-tls-certs\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.521313 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.521278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpmlg\" (UniqueName: \"kubernetes.io/projected/519fc1c9-d38e-404f-9694-4683deeedf51-kube-api-access-kpmlg\") pod \"lora-multiple-adapters-test-kserve-54b58777fc-nccnt\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.616460 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.616356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:25.796351 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:25.796320    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"]
Jul 08 08:19:25.799310 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:19:25.799279    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519fc1c9_d38e_404f_9694_4683deeedf51.slice/crio-05eb3834c9cec2354a9774acdba152e1fa5ff9238aa2d3baaec36578f4df6e45 WatchSource:0}: Error finding container 05eb3834c9cec2354a9774acdba152e1fa5ff9238aa2d3baaec36578f4df6e45: Status 404 returned error can't find the container with id 05eb3834c9cec2354a9774acdba152e1fa5ff9238aa2d3baaec36578f4df6e45
Jul 08 08:19:26.235029 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:26.234990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" event={"ID":"519fc1c9-d38e-404f-9694-4683deeedf51","Type":"ContainerStarted","Data":"f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9"}
Jul 08 08:19:26.235215 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:26.235069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" event={"ID":"519fc1c9-d38e-404f-9694-4683deeedf51","Type":"ContainerStarted","Data":"05eb3834c9cec2354a9774acdba152e1fa5ff9238aa2d3baaec36578f4df6e45"}
Jul 08 08:19:31.276237 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:31.276194    2573 generic.go:356] "Generic (PLEG): container finished" podID="519fc1c9-d38e-404f-9694-4683deeedf51" containerID="f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9" exitCode=0
Jul 08 08:19:31.276792 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:31.276257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" event={"ID":"519fc1c9-d38e-404f-9694-4683deeedf51","Type":"ContainerDied","Data":"f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9"}
Jul 08 08:19:32.287013 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:32.286977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" event={"ID":"519fc1c9-d38e-404f-9694-4683deeedf51","Type":"ContainerStarted","Data":"04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0"}
Jul 08 08:19:32.317271 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:32.317206    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podStartSLOduration=2.916672399 podStartE2EDuration="7.317181944s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.400509545s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:19:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:19:32.317175282 +0000 UTC m=+5092.012696164" watchObservedRunningTime="2026-07-08 08:19:32.317181944 +0000 UTC m=+5092.012702827"
Jul 08 08:19:32.616961 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:32.616849    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:32.798135 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:32.798090    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:19:32.840738 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:32.840687    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:19:35.617524 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:35.617483    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:19:35.619508 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:35.619479    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:19:42.797945 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:42.797891    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:19:42.840898 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:42.840846    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:19:45.617816 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:45.617754    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:19:52.798501 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:52.798448    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:19:52.840527 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:52.840480    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:19:55.617694 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:19:55.617640    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:20:02.797997 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:02.797899    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:20:02.840104 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:02.840059    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:20:05.617344 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:05.617280    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:20:12.798239 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:12.798189    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:20:12.840617 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:12.840570    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:20:15.616869 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:15.616832    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:20:22.798354 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:22.798303    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:20:22.840731 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:22.840677    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:20:25.617357 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:25.617299    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:20:32.797899 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:32.797849    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:20:32.840902 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:32.840850    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:20:35.616889 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:35.616835    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:20:42.798129 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:42.798076    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:20:42.840373 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:42.840328    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:20:45.617132 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:45.617076    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 08 08:20:52.798376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:52.798325    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:20:52.840214 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:52.840165    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:20:55.627368 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:55.627334    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:20:55.635509 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:20:55.635483    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:21:02.798149 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:02.798102    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:21:02.840242 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:02.840204    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:21:12.798021 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:12.797967    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:21:12.840021 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:12.839986    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:21:22.797755 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:22.797711    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:21:22.840772 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:22.840721    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:21:32.797999 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:32.797896    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:21:32.840775 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:32.840722    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:21:42.798226 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:42.798180    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:21:42.840142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:42.840101    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:21:52.798458 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:52.798406    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:21:52.840326 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:21:52.840279    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:22:02.797714 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:02.797665    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:22:02.840602 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:02.840565    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:22:12.798311 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:12.798252    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf" podUID="6a8bb147-65b6-4266-9e9e-e69ffc0d2c74" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8001/health\": dial tcp 10.133.0.58:8001: connect: connection refused"
Jul 08 08:22:12.840392 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:12.840322    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng" podUID="9c57983a-88f5-4615-9e6b-8bafc4a48dfa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": dial tcp 10.133.0.59:8000: connect: connection refused"
Jul 08 08:22:22.813967 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:22.813932    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:22:22.843674 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:22.843635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6978d748b8-9ssnf"
Jul 08 08:22:22.859557 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:22.859523    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:22:22.874209 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:22.874183    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng"
Jul 08 08:22:39.604340 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:39.604281    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"]
Jul 08 08:22:54.631540 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:54.631498    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main" containerID="cri-o://04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0" gracePeriod=45
Jul 08 08:22:55.313958 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.313933    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:22:55.363177 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363092    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-kserve-provision-location\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363177 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363140    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-dshm\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363177 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363173    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-model-cache\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363442 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363202    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpmlg\" (UniqueName: \"kubernetes.io/projected/519fc1c9-d38e-404f-9694-4683deeedf51-kube-api-access-kpmlg\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363442 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363239    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/519fc1c9-d38e-404f-9694-4683deeedf51-tls-certs\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363442 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/519fc1c9-d38e-404f-9694-4683deeedf51-cabundle-cert\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363601 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363469    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-tmp-dir\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363601 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363503    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-home\") pod \"519fc1c9-d38e-404f-9694-4683deeedf51\" (UID: \"519fc1c9-d38e-404f-9694-4683deeedf51\") "
Jul 08 08:22:55.363823 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363465    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-model-cache" (OuterVolumeSpecName: "model-cache") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:22:55.364097 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.363790    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519fc1c9-d38e-404f-9694-4683deeedf51-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 08:22:55.364254 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.364211    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-home" (OuterVolumeSpecName: "home") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:22:55.366279 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.366249    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519fc1c9-d38e-404f-9694-4683deeedf51-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:22:55.366408 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.366270    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519fc1c9-d38e-404f-9694-4683deeedf51-kube-api-access-kpmlg" (OuterVolumeSpecName: "kube-api-access-kpmlg") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "kube-api-access-kpmlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:22:55.366408 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.366324    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-dshm" (OuterVolumeSpecName: "dshm") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:22:55.379893 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.379854    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:22:55.401264 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.401222    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "519fc1c9-d38e-404f-9694-4683deeedf51" (UID: "519fc1c9-d38e-404f-9694-4683deeedf51"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:22:55.464487 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464453    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/519fc1c9-d38e-404f-9694-4683deeedf51-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.464487 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464481    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/519fc1c9-d38e-404f-9694-4683deeedf51-cabundle-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.464487 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464490    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.464487 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464497    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.464792 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464506    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.464792 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464516    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.464792 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464524    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/519fc1c9-d38e-404f-9694-4683deeedf51-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.464792 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.464534    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpmlg\" (UniqueName: \"kubernetes.io/projected/519fc1c9-d38e-404f-9694-4683deeedf51-kube-api-access-kpmlg\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:22:55.630665 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.630578    2573 generic.go:356] "Generic (PLEG): container finished" podID="519fc1c9-d38e-404f-9694-4683deeedf51" containerID="04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0" exitCode=0
Jul 08 08:22:55.630665 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.630631    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"
Jul 08 08:22:55.630665 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.630642    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" event={"ID":"519fc1c9-d38e-404f-9694-4683deeedf51","Type":"ContainerDied","Data":"04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0"}
Jul 08 08:22:55.630971 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.630699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt" event={"ID":"519fc1c9-d38e-404f-9694-4683deeedf51","Type":"ContainerDied","Data":"05eb3834c9cec2354a9774acdba152e1fa5ff9238aa2d3baaec36578f4df6e45"}
Jul 08 08:22:55.630971 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.630721    2573 scope.go:117] "RemoveContainer" containerID="04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0"
Jul 08 08:22:55.640990 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.640817    2573 scope.go:117] "RemoveContainer" containerID="f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9"
Jul 08 08:22:55.650306 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.650234    2573 scope.go:117] "RemoveContainer" containerID="04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0"
Jul 08 08:22:55.650703 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:22:55.650676    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0\": container with ID starting with 04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0 not found: ID does not exist" containerID="04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0"
Jul 08 08:22:55.650806 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.650717    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0"} err="failed to get container status \"04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0\": rpc error: code = NotFound desc = could not find container \"04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0\": container with ID starting with 04620de3ad6e10cbb10b5aea28e9652f591177787eb97b2f71e069150edcffe0 not found: ID does not exist"
Jul 08 08:22:55.650806 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.650742    2573 scope.go:117] "RemoveContainer" containerID="f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9"
Jul 08 08:22:55.651266 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:22:55.651223    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9\": container with ID starting with f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9 not found: ID does not exist" containerID="f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9"
Jul 08 08:22:55.651374 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.651281    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9"} err="failed to get container status \"f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9\": rpc error: code = NotFound desc = could not find container \"f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9\": container with ID starting with f0c685ceecd3ea2ce90d9deabf9b242539cfe44811868911c4c4d03b25e5cad9 not found: ID does not exist"
Jul 08 08:22:55.653923 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.653904    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"]
Jul 08 08:22:55.659331 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:55.659308    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-54b58777fc-nccnt"]
Jul 08 08:22:56.822778 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:22:56.822734    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" path="/var/lib/kubelet/pods/519fc1c9-d38e-404f-9694-4683deeedf51/volumes"
Jul 08 08:23:19.799450 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.799371    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"]
Jul 08 08:23:19.799927 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.799858    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main"
Jul 08 08:23:19.799927 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.799874    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main"
Jul 08 08:23:19.799927 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.799892    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="storage-initializer"
Jul 08 08:23:19.799927 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.799897    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="storage-initializer"
Jul 08 08:23:19.800122 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.799961    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="519fc1c9-d38e-404f-9694-4683deeedf51" containerName="main"
Jul 08 08:23:19.803336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.803313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.805833 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.805806    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"tls-verification-test-kserve-self-signed-certs\""
Jul 08 08:23:19.816886 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.816815    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"]
Jul 08 08:23:19.889830 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.889788    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-home\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.889830 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.889835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tls-certs\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.890062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.889882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-dshm\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.890062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.889901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tmp-dir\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.890062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.890006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-model-cache\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.890062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.890037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kserve-provision-location\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.890062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.890055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btvqq\" (UniqueName: \"kubernetes.io/projected/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kube-api-access-btvqq\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.990755 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.990711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-model-cache\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.990755 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.990755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kserve-provision-location\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.990798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btvqq\" (UniqueName: \"kubernetes.io/projected/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kube-api-access-btvqq\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.990817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-home\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.990835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tls-certs\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.990879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-dshm\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.990901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tmp-dir\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991343 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.991190    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-model-cache\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991343 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.991252    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-home\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991422 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.991364    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kserve-provision-location\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.991679 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.991436    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tmp-dir\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.993163 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.993134    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-dshm\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.993319 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.993301    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tls-certs\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:19.999572 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:19.999546    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btvqq\" (UniqueName: \"kubernetes.io/projected/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kube-api-access-btvqq\") pod \"tls-verification-test-kserve-c8f5cf957-2cgdc\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:20.115009 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:20.114910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:20.276792 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:20.276748    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"]
Jul 08 08:23:20.278631 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:23:20.278604    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f06fb2_54c9_4eb9_ba0f_02f4e1f12b11.slice/crio-ea95a5ca481e5d2d2206e53aab10c4de2ac58d3d8c78aa9899eaaff37803df41 WatchSource:0}: Error finding container ea95a5ca481e5d2d2206e53aab10c4de2ac58d3d8c78aa9899eaaff37803df41: Status 404 returned error can't find the container with id ea95a5ca481e5d2d2206e53aab10c4de2ac58d3d8c78aa9899eaaff37803df41
Jul 08 08:23:20.782611 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:20.782565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" event={"ID":"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11","Type":"ContainerStarted","Data":"a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c"}
Jul 08 08:23:20.782838 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:20.782632    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" event={"ID":"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11","Type":"ContainerStarted","Data":"ea95a5ca481e5d2d2206e53aab10c4de2ac58d3d8c78aa9899eaaff37803df41"}
Jul 08 08:23:23.801992 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:23.801959    2573 generic.go:356] "Generic (PLEG): container finished" podID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerID="a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c" exitCode=0
Jul 08 08:23:23.802412 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:23.802047    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" event={"ID":"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11","Type":"ContainerDied","Data":"a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c"}
Jul 08 08:23:24.810286 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:24.810254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" event={"ID":"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11","Type":"ContainerStarted","Data":"fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf"}
Jul 08 08:23:24.835509 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:24.835436    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podStartSLOduration=2.476876973 podStartE2EDuration="5.835412607s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.358535634s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:23:24.833106084 +0000 UTC m=+5324.528626977" watchObservedRunningTime="2026-07-08 08:23:24.835412607 +0000 UTC m=+5324.530933489"
Jul 08 08:23:25.116491 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:25.116392    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:30.115751 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:30.115703    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:23:30.117758 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:30.117725    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:23:40.116210 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:40.116152    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:23:50.116098 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:23:50.116052    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:24:00.115927 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:24:00.115886    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:24:10.116308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:24:10.116258    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:24:20.116012 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:24:20.115965    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:24:30.115910 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:24:30.115864    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:24:40.116725 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:24:40.116679    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:24:50.116291 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:24:50.116243    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:25:00.116559 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:00.116496    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:25:10.116576 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:10.116536    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:25:20.116418 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:20.116372    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:25:30.126379 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:30.126345    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:25:30.135114 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:30.135084    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:25:35.682422 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:35.682378    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"]
Jul 08 08:25:50.711744 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:50.711697    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" containerID="cri-o://fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf" gracePeriod=45
Jul 08 08:25:51.126920 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.126878    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": dial tcp 10.133.0.61:8000: connect: connection refused"
Jul 08 08:25:51.480573 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.480549    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:25:51.534142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534104    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-dshm\") pod \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") "
Jul 08 08:25:51.534336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534164    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tmp-dir\") pod \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") "
Jul 08 08:25:51.534336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kserve-provision-location\") pod \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") "
Jul 08 08:25:51.534336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534218    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tls-certs\") pod \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") "
Jul 08 08:25:51.534336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534296    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-model-cache\") pod \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") "
Jul 08 08:25:51.534336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534315    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btvqq\" (UniqueName: \"kubernetes.io/projected/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kube-api-access-btvqq\") pod \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") "
Jul 08 08:25:51.534620 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534478    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-home\") pod \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\" (UID: \"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11\") "
Jul 08 08:25:51.534620 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534571    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-model-cache" (OuterVolumeSpecName: "model-cache") pod "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" (UID: "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:25:51.535010 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.534899    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:25:51.535352 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.535324    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-home" (OuterVolumeSpecName: "home") pod "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" (UID: "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:25:51.536636 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.536599    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kube-api-access-btvqq" (OuterVolumeSpecName: "kube-api-access-btvqq") pod "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" (UID: "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11"). InnerVolumeSpecName "kube-api-access-btvqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:25:51.536896 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.536845    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" (UID: "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:25:51.537083 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.537056    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-dshm" (OuterVolumeSpecName: "dshm") pod "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" (UID: "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:25:51.549890 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.549857    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" (UID: "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:25:51.589179 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.589124    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" (UID: "24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:25:51.635788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.635672    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:25:51.635788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.635701    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:25:51.635788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.635712    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:25:51.635788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.635728    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:25:51.635788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.635736    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:25:51.635788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.635747    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btvqq\" (UniqueName: \"kubernetes.io/projected/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11-kube-api-access-btvqq\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:25:51.698914 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.698876    2573 generic.go:356] "Generic (PLEG): container finished" podID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerID="fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf" exitCode=0
Jul 08 08:25:51.699086 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.698934    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"
Jul 08 08:25:51.699086 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.698955    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" event={"ID":"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11","Type":"ContainerDied","Data":"fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf"}
Jul 08 08:25:51.699086 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.699009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc" event={"ID":"24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11","Type":"ContainerDied","Data":"ea95a5ca481e5d2d2206e53aab10c4de2ac58d3d8c78aa9899eaaff37803df41"}
Jul 08 08:25:51.699086 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.699032    2573 scope.go:117] "RemoveContainer" containerID="fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf"
Jul 08 08:25:51.709611 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.709591    2573 scope.go:117] "RemoveContainer" containerID="a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c"
Jul 08 08:25:51.719067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.718828    2573 scope.go:117] "RemoveContainer" containerID="fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf"
Jul 08 08:25:51.719306 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:25:51.719118    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf\": container with ID starting with fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf not found: ID does not exist" containerID="fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf"
Jul 08 08:25:51.719306 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.719148    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf"} err="failed to get container status \"fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf\": rpc error: code = NotFound desc = could not find container \"fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf\": container with ID starting with fcf8ad97dfbc252c36240c268576d49c7db0fae322492fe3c19133fc49396acf not found: ID does not exist"
Jul 08 08:25:51.719306 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.719166    2573 scope.go:117] "RemoveContainer" containerID="a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c"
Jul 08 08:25:51.719452 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:25:51.719438    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c\": container with ID starting with a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c not found: ID does not exist" containerID="a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c"
Jul 08 08:25:51.719490 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.719458    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c"} err="failed to get container status \"a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c\": rpc error: code = NotFound desc = could not find container \"a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c\": container with ID starting with a156e0f9a3451dad877bd3f3155d103c4751726712155b4f7719172d5461b32c not found: ID does not exist"
Jul 08 08:25:51.731918 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.731889    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"]
Jul 08 08:25:51.734316 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:51.734293    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-c8f5cf957-2cgdc"]
Jul 08 08:25:52.822405 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:25:52.822370    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" path="/var/lib/kubelet/pods/24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11/volumes"
Jul 08 08:26:07.380673 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.380590    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"]
Jul 08 08:26:07.381142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.381050    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main"
Jul 08 08:26:07.381142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.381067    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main"
Jul 08 08:26:07.381142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.381091    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="storage-initializer"
Jul 08 08:26:07.381142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.381103    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="storage-initializer"
Jul 08 08:26:07.381281 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.381226    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f06fb2-54c9-4eb9-ba0f-02f4e1f12b11" containerName="main"
Jul 08 08:26:07.386289 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.386269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.389151 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.389127    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"prestop-hook-test-kserve-self-signed-certs\""
Jul 08 08:26:07.397522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.397499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"]
Jul 08 08:26:07.478996 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.478960    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-home\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.479184 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.479008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tmp-dir\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.479184 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.479057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-model-cache\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.479184 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.479080    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kserve-provision-location\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.479184 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.479162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tls-certs\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.479329 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.479207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghv2w\" (UniqueName: \"kubernetes.io/projected/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kube-api-access-ghv2w\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.479329 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.479317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-dshm\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.579930 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.579885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-dshm\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580128 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.579946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-home\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580128 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.579984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tmp-dir\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580128 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.580013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-model-cache\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580128 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.580038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kserve-provision-location\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580452 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.580425    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-home\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580558 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.580468    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kserve-provision-location\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580558 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.580491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tls-certs\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580558 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.580510    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-model-cache\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.580558 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.580537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghv2w\" (UniqueName: \"kubernetes.io/projected/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kube-api-access-ghv2w\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.581132 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.581104    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tmp-dir\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.583104 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.583078    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-dshm\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.583280 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.583260    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tls-certs\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.588809 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.588780    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghv2w\" (UniqueName: \"kubernetes.io/projected/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kube-api-access-ghv2w\") pod \"prestop-hook-test-kserve-66dc64cccc-g4xc2\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.698282 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.698178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:07.861797 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:07.861753    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"]
Jul 08 08:26:07.864046 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:26:07.864022    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04eaba9f_d2c0_4ad7_adff_632ca080e89c.slice/crio-012baeea097b640ba01ced73bf5270bc1cfab60521b1f6ed004bad1d3fa79718 WatchSource:0}: Error finding container 012baeea097b640ba01ced73bf5270bc1cfab60521b1f6ed004bad1d3fa79718: Status 404 returned error can't find the container with id 012baeea097b640ba01ced73bf5270bc1cfab60521b1f6ed004bad1d3fa79718
Jul 08 08:26:08.801155 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:08.801119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" event={"ID":"04eaba9f-d2c0-4ad7-adff-632ca080e89c","Type":"ContainerStarted","Data":"17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1"}
Jul 08 08:26:08.801618 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:08.801169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" event={"ID":"04eaba9f-d2c0-4ad7-adff-632ca080e89c","Type":"ContainerStarted","Data":"012baeea097b640ba01ced73bf5270bc1cfab60521b1f6ed004bad1d3fa79718"}
Jul 08 08:26:11.822328 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:11.822231    2573 generic.go:356] "Generic (PLEG): container finished" podID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerID="17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1" exitCode=0
Jul 08 08:26:11.822328 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:11.822311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" event={"ID":"04eaba9f-d2c0-4ad7-adff-632ca080e89c","Type":"ContainerDied","Data":"17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1"}
Jul 08 08:26:12.840087 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:12.840053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" event={"ID":"04eaba9f-d2c0-4ad7-adff-632ca080e89c","Type":"ContainerStarted","Data":"5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde"}
Jul 08 08:26:12.865090 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:12.865026    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podStartSLOduration=2.286566639 podStartE2EDuration="5.865004697s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.578438058s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:26:12.861791096 +0000 UTC m=+5492.557311974" watchObservedRunningTime="2026-07-08 08:26:12.865004697 +0000 UTC m=+5492.560525581"
Jul 08 08:26:13.699081 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:13.699042    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:17.698344 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:17.698304    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:26:17.700297 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:17.700256    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:26:27.699041 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:27.698994    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:26:37.698887 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:37.698842    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:26:47.699060 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:47.699010    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:26:57.698850 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:26:57.698797    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:27:07.699680 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:27:07.699624    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:27:17.698656 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:27:17.698604    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:27:27.698809 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:27:27.698752    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:27:37.698669 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:27:37.698567    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:27:47.699594 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:27:47.699554    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:27:57.699160 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:27:57.699112    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:28:07.699207 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:07.699156    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": dial tcp 10.133.0.62:8000: connect: connection refused"
Jul 08 08:28:17.708820 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:17.708790    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:28:17.717386 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:17.717339    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:28:21.624454 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.624415    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"]
Jul 08 08:28:21.653702 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.653673    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"]
Jul 08 08:28:21.657524 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.657505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.659346 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.659314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-home\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.659481 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.659355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tmp-dir\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.659481 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.659376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tls-certs\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.659481 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.659435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-model-cache\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.659617 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.659478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kserve-provision-location\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.659617 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.659506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dnpc\" (UniqueName: \"kubernetes.io/projected/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kube-api-access-5dnpc\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.659617 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.659592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-dshm\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.671612 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.671581    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"]
Jul 08 08:28:21.760863 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.760827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-dshm\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.760922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-home\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.760940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tmp-dir\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.760955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tls-certs\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.760974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-model-cache\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.760993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kserve-provision-location\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.761010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnpc\" (UniqueName: \"kubernetes.io/projected/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kube-api-access-5dnpc\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761473 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.761445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tmp-dir\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761592 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.761477    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kserve-provision-location\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761592 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.761488    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-model-cache\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.761592 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.761564    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-home\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.763141 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.763116    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-dshm\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.763426 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.763409    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tls-certs\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.770022 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.769995    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dnpc\" (UniqueName: \"kubernetes.io/projected/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kube-api-access-5dnpc\") pod \"prestop-hook-test-kserve-66dc64cccc-8b724\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:21.968927 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:21.968835    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:22.124534 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:22.121494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"]
Jul 08 08:28:22.126939 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:28:22.126900    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16131efd_723a_4a3a_9155_0e2fdc0b28c2.slice/crio-a812402a01d98e994c448d47bf318149bd411890d73feeee9c536ea1afdd2c92 WatchSource:0}: Error finding container a812402a01d98e994c448d47bf318149bd411890d73feeee9c536ea1afdd2c92: Status 404 returned error can't find the container with id a812402a01d98e994c448d47bf318149bd411890d73feeee9c536ea1afdd2c92
Jul 08 08:28:22.633142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:22.633106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" event={"ID":"16131efd-723a-4a3a-9155-0e2fdc0b28c2","Type":"ContainerStarted","Data":"834e3173cd2ee2ccd90aae468234c54716c1f8adc0d0cffc25a3d351762f0530"}
Jul 08 08:28:22.633606 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:22.633171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" event={"ID":"16131efd-723a-4a3a-9155-0e2fdc0b28c2","Type":"ContainerStarted","Data":"a812402a01d98e994c448d47bf318149bd411890d73feeee9c536ea1afdd2c92"}
Jul 08 08:28:26.658721 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:26.658689    2573 generic.go:356] "Generic (PLEG): container finished" podID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerID="834e3173cd2ee2ccd90aae468234c54716c1f8adc0d0cffc25a3d351762f0530" exitCode=0
Jul 08 08:28:26.659211 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:26.658780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" event={"ID":"16131efd-723a-4a3a-9155-0e2fdc0b28c2","Type":"ContainerDied","Data":"834e3173cd2ee2ccd90aae468234c54716c1f8adc0d0cffc25a3d351762f0530"}
Jul 08 08:28:27.666694 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:27.666653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" event={"ID":"16131efd-723a-4a3a-9155-0e2fdc0b28c2","Type":"ContainerStarted","Data":"ac042f177b9fafca2b9dca35e90af7b78579c48f3865e33aacc85912af9942db"}
Jul 08 08:28:27.706185 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:27.706122    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" podStartSLOduration=3.193685406 podStartE2EDuration="6.706104927s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.512419521s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:28:27.705796758 +0000 UTC m=+5627.401317640" watchObservedRunningTime="2026-07-08 08:28:27.706104927 +0000 UTC m=+5627.401625808"
Jul 08 08:28:27.969558 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:27.969459    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:31.969843 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:31.969803    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:28:31.971796 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:31.971744    2573 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/health\": dial tcp 10.133.0.63:8000: connect: connection refused"
Jul 08 08:28:36.650536 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:36.650495    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main" containerID="cri-o://5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde" gracePeriod=45
Jul 08 08:28:37.459072 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.458996    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:28:37.515119 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515082    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghv2w\" (UniqueName: \"kubernetes.io/projected/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kube-api-access-ghv2w\") pod \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") "
Jul 08 08:28:37.515303 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-home\") pod \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") "
Jul 08 08:28:37.515303 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515211    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-model-cache\") pod \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") "
Jul 08 08:28:37.515303 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tls-certs\") pod \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") "
Jul 08 08:28:37.515303 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515300    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tmp-dir\") pod \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") "
Jul 08 08:28:37.515536 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515334    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kserve-provision-location\") pod \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") "
Jul 08 08:28:37.515536 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515379    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-dshm\") pod \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\" (UID: \"04eaba9f-d2c0-4ad7-adff-632ca080e89c\") "
Jul 08 08:28:37.516852 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515744    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-home" (OuterVolumeSpecName: "home") pod "04eaba9f-d2c0-4ad7-adff-632ca080e89c" (UID: "04eaba9f-d2c0-4ad7-adff-632ca080e89c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:28:37.516852 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.515784    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-model-cache" (OuterVolumeSpecName: "model-cache") pod "04eaba9f-d2c0-4ad7-adff-632ca080e89c" (UID: "04eaba9f-d2c0-4ad7-adff-632ca080e89c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:28:37.518358 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.518293    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-dshm" (OuterVolumeSpecName: "dshm") pod "04eaba9f-d2c0-4ad7-adff-632ca080e89c" (UID: "04eaba9f-d2c0-4ad7-adff-632ca080e89c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:28:37.519369 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.519343    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04eaba9f-d2c0-4ad7-adff-632ca080e89c" (UID: "04eaba9f-d2c0-4ad7-adff-632ca080e89c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:28:37.519472 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.519446    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kube-api-access-ghv2w" (OuterVolumeSpecName: "kube-api-access-ghv2w") pod "04eaba9f-d2c0-4ad7-adff-632ca080e89c" (UID: "04eaba9f-d2c0-4ad7-adff-632ca080e89c"). InnerVolumeSpecName "kube-api-access-ghv2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:28:37.533908 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.533874    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04eaba9f-d2c0-4ad7-adff-632ca080e89c" (UID: "04eaba9f-d2c0-4ad7-adff-632ca080e89c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:28:37.570035 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.569976    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "04eaba9f-d2c0-4ad7-adff-632ca080e89c" (UID: "04eaba9f-d2c0-4ad7-adff-632ca080e89c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:28:37.617291 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.617245    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:28:37.617291 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.617295    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:28:37.617527 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.617311    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:28:37.617527 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.617326    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghv2w\" (UniqueName: \"kubernetes.io/projected/04eaba9f-d2c0-4ad7-adff-632ca080e89c-kube-api-access-ghv2w\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:28:37.617527 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.617351    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:28:37.617527 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.617366    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eaba9f-d2c0-4ad7-adff-632ca080e89c-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:28:37.617527 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.617380    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eaba9f-d2c0-4ad7-adff-632ca080e89c-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:28:37.735011 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.734909    2573 generic.go:356] "Generic (PLEG): container finished" podID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerID="5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde" exitCode=0
Jul 08 08:28:37.735011 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.734962    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"
Jul 08 08:28:37.735011 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.734995    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" event={"ID":"04eaba9f-d2c0-4ad7-adff-632ca080e89c","Type":"ContainerDied","Data":"5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde"}
Jul 08 08:28:37.735520 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.735054    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2" event={"ID":"04eaba9f-d2c0-4ad7-adff-632ca080e89c","Type":"ContainerDied","Data":"012baeea097b640ba01ced73bf5270bc1cfab60521b1f6ed004bad1d3fa79718"}
Jul 08 08:28:37.735520 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.735083    2573 scope.go:117] "RemoveContainer" containerID="5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde"
Jul 08 08:28:37.746556 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.746537    2573 scope.go:117] "RemoveContainer" containerID="17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1"
Jul 08 08:28:37.755500 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.755482    2573 scope.go:117] "RemoveContainer" containerID="5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde"
Jul 08 08:28:37.755772 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:28:37.755736    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde\": container with ID starting with 5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde not found: ID does not exist" containerID="5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde"
Jul 08 08:28:37.755845 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.755785    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde"} err="failed to get container status \"5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde\": rpc error: code = NotFound desc = could not find container \"5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde\": container with ID starting with 5489f63cf47d609b3a2cddf898cdc8999dba2d5bfbe66c2bf82654358581bcde not found: ID does not exist"
Jul 08 08:28:37.755845 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.755805    2573 scope.go:117] "RemoveContainer" containerID="17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1"
Jul 08 08:28:37.756058 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:28:37.756034    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1\": container with ID starting with 17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1 not found: ID does not exist" containerID="17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1"
Jul 08 08:28:37.756145 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.756059    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1"} err="failed to get container status \"17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1\": rpc error: code = NotFound desc = could not find container \"17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1\": container with ID starting with 17aae1ca5dddf9e8b8095189a36cc5e6e1e402f800df5670eea8efaf4b977fc1 not found: ID does not exist"
Jul 08 08:28:37.761279 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.761255    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"]
Jul 08 08:28:37.765203 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:37.765181    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-g4xc2"]
Jul 08 08:28:38.824257 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:38.824225    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" path="/var/lib/kubelet/pods/04eaba9f-d2c0-4ad7-adff-632ca080e89c/volumes"
Jul 08 08:28:40.505072 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:40.505034    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"]
Jul 08 08:28:55.534208 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:28:55.534168    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerName="main" containerID="cri-o://ac042f177b9fafca2b9dca35e90af7b78579c48f3865e33aacc85912af9942db" gracePeriod=45
Jul 08 08:29:41.121678 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.121612    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_prestop-hook-test-kserve-66dc64cccc-8b724_16131efd-723a-4a3a-9155-0e2fdc0b28c2/main/0.log"
Jul 08 08:29:41.122212 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.122151    2573 generic.go:356] "Generic (PLEG): container finished" podID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerID="ac042f177b9fafca2b9dca35e90af7b78579c48f3865e33aacc85912af9942db" exitCode=137
Jul 08 08:29:41.122446 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.122405    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" event={"ID":"16131efd-723a-4a3a-9155-0e2fdc0b28c2","Type":"ContainerDied","Data":"ac042f177b9fafca2b9dca35e90af7b78579c48f3865e33aacc85912af9942db"}
Jul 08 08:29:41.183211 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.183188    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_prestop-hook-test-kserve-66dc64cccc-8b724_16131efd-723a-4a3a-9155-0e2fdc0b28c2/main/0.log"
Jul 08 08:29:41.185854 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.185833    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:29:41.333450 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333356    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tmp-dir\") pod \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") "
Jul 08 08:29:41.333450 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333397    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-model-cache\") pod \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") "
Jul 08 08:29:41.333698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333463    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dnpc\" (UniqueName: \"kubernetes.io/projected/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kube-api-access-5dnpc\") pod \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") "
Jul 08 08:29:41.333698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333482    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tls-certs\") pod \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") "
Jul 08 08:29:41.333698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333506    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kserve-provision-location\") pod \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") "
Jul 08 08:29:41.333698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-dshm\") pod \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") "
Jul 08 08:29:41.333698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333602    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-home\") pod \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\" (UID: \"16131efd-723a-4a3a-9155-0e2fdc0b28c2\") "
Jul 08 08:29:41.333979 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333711    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "16131efd-723a-4a3a-9155-0e2fdc0b28c2" (UID: "16131efd-723a-4a3a-9155-0e2fdc0b28c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:29:41.333979 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.333911    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:29:41.334142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.334116    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-home" (OuterVolumeSpecName: "home") pod "16131efd-723a-4a3a-9155-0e2fdc0b28c2" (UID: "16131efd-723a-4a3a-9155-0e2fdc0b28c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:29:41.334202 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.334122    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "16131efd-723a-4a3a-9155-0e2fdc0b28c2" (UID: "16131efd-723a-4a3a-9155-0e2fdc0b28c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:29:41.335737 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.335695    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "16131efd-723a-4a3a-9155-0e2fdc0b28c2" (UID: "16131efd-723a-4a3a-9155-0e2fdc0b28c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:29:41.335870 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.335804    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-dshm" (OuterVolumeSpecName: "dshm") pod "16131efd-723a-4a3a-9155-0e2fdc0b28c2" (UID: "16131efd-723a-4a3a-9155-0e2fdc0b28c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:29:41.336062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.336040    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kube-api-access-5dnpc" (OuterVolumeSpecName: "kube-api-access-5dnpc") pod "16131efd-723a-4a3a-9155-0e2fdc0b28c2" (UID: "16131efd-723a-4a3a-9155-0e2fdc0b28c2"). InnerVolumeSpecName "kube-api-access-5dnpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:29:41.392093 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.392045    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "16131efd-723a-4a3a-9155-0e2fdc0b28c2" (UID: "16131efd-723a-4a3a-9155-0e2fdc0b28c2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:29:41.398950 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.398929    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_prestop-hook-test-kserve-66dc64cccc-8b724_16131efd-723a-4a3a-9155-0e2fdc0b28c2/main/0.log"
Jul 08 08:29:41.434383 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.434356    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kserve-provision-location\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:29:41.434522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.434391    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:29:41.434522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.434406    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:29:41.434522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.434413    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16131efd-723a-4a3a-9155-0e2fdc0b28c2-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:29:41.434522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.434422    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dnpc\" (UniqueName: \"kubernetes.io/projected/16131efd-723a-4a3a-9155-0e2fdc0b28c2-kube-api-access-5dnpc\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:29:41.434522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.434430    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16131efd-723a-4a3a-9155-0e2fdc0b28c2-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:29:41.434522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:41.434368    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_prestop-hook-test-kserve-66dc64cccc-8b724_16131efd-723a-4a3a-9155-0e2fdc0b28c2/main/0.log"
Jul 08 08:29:42.129892 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:42.129865    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"
Jul 08 08:29:42.130328 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:42.129872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724" event={"ID":"16131efd-723a-4a3a-9155-0e2fdc0b28c2","Type":"ContainerDied","Data":"a812402a01d98e994c448d47bf318149bd411890d73feeee9c536ea1afdd2c92"}
Jul 08 08:29:42.130328 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:42.129996    2573 scope.go:117] "RemoveContainer" containerID="ac042f177b9fafca2b9dca35e90af7b78579c48f3865e33aacc85912af9942db"
Jul 08 08:29:42.139674 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:42.139658    2573 scope.go:117] "RemoveContainer" containerID="834e3173cd2ee2ccd90aae468234c54716c1f8adc0d0cffc25a3d351762f0530"
Jul 08 08:29:42.169752 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:42.169722    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"]
Jul 08 08:29:42.171960 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:42.171934    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-66dc64cccc-8b724"]
Jul 08 08:29:42.822918 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:29:42.822887    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" path="/var/lib/kubelet/pods/16131efd-723a-4a3a-9155-0e2fdc0b28c2/volumes"
Jul 08 08:30:27.668409 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668376    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"]
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668809    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main"
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668821    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main"
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668835    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerName="storage-initializer"
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668842    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerName="storage-initializer"
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668855    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerName="main"
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668860    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerName="main"
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668875    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="storage-initializer"
Jul 08 08:30:27.668885 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668880    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="storage-initializer"
Jul 08 08:30:27.669143 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668932    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="04eaba9f-d2c0-4ad7-adff-632ca080e89c" containerName="main"
Jul 08 08:30:27.669143 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.668942    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="16131efd-723a-4a3a-9155-0e2fdc0b28c2" containerName="main"
Jul 08 08:30:27.672087 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.672067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.674542 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.674515    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Jul 08 08:30:27.681059 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.681038    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"]
Jul 08 08:30:27.848386 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.848355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6994039b-7194-4f6b-ac10-755e870189a7-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.848386 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.848396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.848594 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.848417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.848594 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.848496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.848594 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.848530    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4grd6\" (UniqueName: \"kubernetes.io/projected/6994039b-7194-4f6b-ac10-755e870189a7-kube-api-access-4grd6\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.848695 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.848612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.949502 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6994039b-7194-4f6b-ac10-755e870189a7-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.949502 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.949502 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.949801 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949518    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.949801 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4grd6\" (UniqueName: \"kubernetes.io/projected/6994039b-7194-4f6b-ac10-755e870189a7-kube-api-access-4grd6\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.949801 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.949978 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949902    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.950038 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949988    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.950038 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.949992    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.951955 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.951926    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.952155 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.952138    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6994039b-7194-4f6b-ac10-755e870189a7-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.958504 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.958483    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4grd6\" (UniqueName: \"kubernetes.io/projected/6994039b-7194-4f6b-ac10-755e870189a7-kube-api-access-4grd6\") pod \"rolling-upgrade-test-kserve-859df57bcb-xgmfs\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:27.983674 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:27.983637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:28.122233 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:28.122126    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"]
Jul 08 08:30:28.124583 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:30:28.124556    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6994039b_7194_4f6b_ac10_755e870189a7.slice/crio-aa87ba5fbcc7c86034d4aecc88ca6bc857109fa71b58d6fe3377382318d85511 WatchSource:0}: Error finding container aa87ba5fbcc7c86034d4aecc88ca6bc857109fa71b58d6fe3377382318d85511: Status 404 returned error can't find the container with id aa87ba5fbcc7c86034d4aecc88ca6bc857109fa71b58d6fe3377382318d85511
Jul 08 08:30:28.388456 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:28.388417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs" event={"ID":"6994039b-7194-4f6b-ac10-755e870189a7","Type":"ContainerStarted","Data":"247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a"}
Jul 08 08:30:28.388640 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:28.388484    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs" event={"ID":"6994039b-7194-4f6b-ac10-755e870189a7","Type":"ContainerStarted","Data":"aa87ba5fbcc7c86034d4aecc88ca6bc857109fa71b58d6fe3377382318d85511"}
Jul 08 08:30:28.408779 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:28.408701    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs" podStartSLOduration=1.408684216 podStartE2EDuration="1.408684216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 08:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:30:28.407848199 +0000 UTC m=+5748.103369078" watchObservedRunningTime="2026-07-08 08:30:28.408684216 +0000 UTC m=+5748.104205095"
Jul 08 08:30:28.983865 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:28.983831    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:37.984115 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:37.984012    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:37.997405 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:37.997368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:38.458645 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:38.458617    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:43.608508 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:43.608472    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"]
Jul 08 08:30:58.635995 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.635945    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs" podUID="6994039b-7194-4f6b-ac10-755e870189a7" containerName="main" containerID="cri-o://247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a" gracePeriod=45
Jul 08 08:30:58.889941 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.889876    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:58.936347 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936316    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6994039b-7194-4f6b-ac10-755e870189a7-tls-certs\") pod \"6994039b-7194-4f6b-ac10-755e870189a7\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") "
Jul 08 08:30:58.936514 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936365    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-home\") pod \"6994039b-7194-4f6b-ac10-755e870189a7\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") "
Jul 08 08:30:58.936514 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936396    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4grd6\" (UniqueName: \"kubernetes.io/projected/6994039b-7194-4f6b-ac10-755e870189a7-kube-api-access-4grd6\") pod \"6994039b-7194-4f6b-ac10-755e870189a7\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") "
Jul 08 08:30:58.936514 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936426    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-model-cache\") pod \"6994039b-7194-4f6b-ac10-755e870189a7\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") "
Jul 08 08:30:58.936514 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936501    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-dshm\") pod \"6994039b-7194-4f6b-ac10-755e870189a7\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") "
Jul 08 08:30:58.936725 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936547    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-tmp-dir\") pod \"6994039b-7194-4f6b-ac10-755e870189a7\" (UID: \"6994039b-7194-4f6b-ac10-755e870189a7\") "
Jul 08 08:30:58.936725 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936663    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-home" (OuterVolumeSpecName: "home") pod "6994039b-7194-4f6b-ac10-755e870189a7" (UID: "6994039b-7194-4f6b-ac10-755e870189a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:30:58.936887 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936857    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "6994039b-7194-4f6b-ac10-755e870189a7" (UID: "6994039b-7194-4f6b-ac10-755e870189a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:30:58.936969 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936895    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6994039b-7194-4f6b-ac10-755e870189a7" (UID: "6994039b-7194-4f6b-ac10-755e870189a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:30:58.936969 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.936909    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-home\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:30:58.938574 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.938547    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6994039b-7194-4f6b-ac10-755e870189a7-kube-api-access-4grd6" (OuterVolumeSpecName: "kube-api-access-4grd6") pod "6994039b-7194-4f6b-ac10-755e870189a7" (UID: "6994039b-7194-4f6b-ac10-755e870189a7"). InnerVolumeSpecName "kube-api-access-4grd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:30:58.938574 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.938566    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6994039b-7194-4f6b-ac10-755e870189a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6994039b-7194-4f6b-ac10-755e870189a7" (UID: "6994039b-7194-4f6b-ac10-755e870189a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:30:58.938958 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:58.938939    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-dshm" (OuterVolumeSpecName: "dshm") pod "6994039b-7194-4f6b-ac10-755e870189a7" (UID: "6994039b-7194-4f6b-ac10-755e870189a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 08:30:59.037902 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.037871    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-model-cache\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:30:59.037902 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.037901    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-dshm\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:30:59.037902 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.037910    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6994039b-7194-4f6b-ac10-755e870189a7-tmp-dir\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:30:59.038153 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.037918    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6994039b-7194-4f6b-ac10-755e870189a7-tls-certs\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:30:59.038153 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.037927    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4grd6\" (UniqueName: \"kubernetes.io/projected/6994039b-7194-4f6b-ac10-755e870189a7-kube-api-access-4grd6\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:30:59.573981 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.573939    2573 generic.go:356] "Generic (PLEG): container finished" podID="6994039b-7194-4f6b-ac10-755e870189a7" containerID="247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a" exitCode=0
Jul 08 08:30:59.573981 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.573984    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"
Jul 08 08:30:59.574207 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.574018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs" event={"ID":"6994039b-7194-4f6b-ac10-755e870189a7","Type":"ContainerDied","Data":"247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a"}
Jul 08 08:30:59.574207 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.574069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs" event={"ID":"6994039b-7194-4f6b-ac10-755e870189a7","Type":"ContainerDied","Data":"aa87ba5fbcc7c86034d4aecc88ca6bc857109fa71b58d6fe3377382318d85511"}
Jul 08 08:30:59.574207 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.574095    2573 scope.go:117] "RemoveContainer" containerID="247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a"
Jul 08 08:30:59.584175 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.584153    2573 scope.go:117] "RemoveContainer" containerID="247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a"
Jul 08 08:30:59.584495 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:30:59.584475    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a\": container with ID starting with 247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a not found: ID does not exist" containerID="247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a"
Jul 08 08:30:59.584562 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.584505    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a"} err="failed to get container status \"247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a\": rpc error: code = NotFound desc = could not find container \"247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a\": container with ID starting with 247f505aa975a87457485d8958bc2e5a7246e62caac82548a3b6132f7533779a not found: ID does not exist"
Jul 08 08:30:59.599341 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.599310    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"]
Jul 08 08:30:59.604728 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:30:59.604702    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xgmfs"]
Jul 08 08:31:00.823819 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:00.823754    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6994039b-7194-4f6b-ac10-755e870189a7" path="/var/lib/kubelet/pods/6994039b-7194-4f6b-ac10-755e870189a7/volumes"
Jul 08 08:31:38.415304 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.415267    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"]
Jul 08 08:31:38.415897 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.415462    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm" podUID="b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" containerName="manager" containerID="cri-o://20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36" gracePeriod=30
Jul 08 08:31:38.679048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.678980    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 08:31:38.807243 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.807212    2573 generic.go:356] "Generic (PLEG): container finished" podID="b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" containerID="20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36" exitCode=0
Jul 08 08:31:38.807413 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.807258    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"
Jul 08 08:31:38.807413 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.807294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm" event={"ID":"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1","Type":"ContainerDied","Data":"20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36"}
Jul 08 08:31:38.807413 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.807342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm" event={"ID":"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1","Type":"ContainerDied","Data":"488028788ec32be95ac51dc1b4ee669154fe472e43bddd414793dc0af16029e7"}
Jul 08 08:31:38.807413 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.807365    2573 scope.go:117] "RemoveContainer" containerID="20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36"
Jul 08 08:31:38.812698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.812363    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert\") pod \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") "
Jul 08 08:31:38.812698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.812410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl5pc\" (UniqueName: \"kubernetes.io/projected/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-kube-api-access-fl5pc\") pod \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\" (UID: \"b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1\") "
Jul 08 08:31:38.815062 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.815025    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert" (OuterVolumeSpecName: "cert") pod "b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" (UID: "b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 08:31:38.815257 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.815217    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-kube-api-access-fl5pc" (OuterVolumeSpecName: "kube-api-access-fl5pc") pod "b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" (UID: "b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1"). InnerVolumeSpecName "kube-api-access-fl5pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 08:31:38.820361 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.820124    2573 scope.go:117] "RemoveContainer" containerID="20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36"
Jul 08 08:31:38.821173 ip-10-0-136-129 kubenswrapper[2573]: E0708 08:31:38.821080    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36\": container with ID starting with 20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36 not found: ID does not exist" containerID="20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36"
Jul 08 08:31:38.821173 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.821114    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36"} err="failed to get container status \"20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36\": rpc error: code = NotFound desc = could not find container \"20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36\": container with ID starting with 20966bd9801496d83402b586362a3d49f39e769063b6626a7549f370bae17d36 not found: ID does not exist"
Jul 08 08:31:38.913949 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.913909    2573 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-cert\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:31:38.913949 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:38.913944    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl5pc\" (UniqueName: \"kubernetes.io/projected/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1-kube-api-access-fl5pc\") on node \"ip-10-0-136-129.ec2.internal\" DevicePath \"\""
Jul 08 08:31:39.133242 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:39.133190    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"]
Jul 08 08:31:39.135589 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:39.135561    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/llmisvc-controller-manager-7f5b66ddfc-7vmfm"]
Jul 08 08:31:40.822942 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:31:40.822913    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" path="/var/lib/kubelet/pods/b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1/volumes"
Jul 08 08:33:33.337538 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:33.337452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:33:33.348556 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:33.348529    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:33:33.360019 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:33.359980    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:33:33.377798 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:33.377773    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:33:33.393132 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:33.393095    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:33:56.521858 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.521817    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:33:56.554475 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.554440    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:33:56.567104 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.567077    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:33:56.618145 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.618116    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:33:56.630697 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.630672    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:33:56.642888 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.642863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:33:56.666079 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.666050    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:33:56.674852 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.674828    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:33:56.791169 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.791089    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:33:56.803633 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:56.803597    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:33:59.890946 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:59.890908    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:33:59.908462 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:59.908428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:33:59.920451 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:59.920427    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:33:59.983259 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:59.983231    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:33:59.993948 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:33:59.993925    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:00.005529 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:00.005491    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:00.029044 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:00.029014    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:00.036785 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:00.036746    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:00.147484 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:00.147393    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:00.159698 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:00.159661    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:03.192027 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.191995    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:03.209120 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.209087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:03.221542 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.221511    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:03.277419 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.277386    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:03.288623 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.288596    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:03.300525 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.300498    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:03.325541 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.325512    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:03.333824 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.333798    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:03.440976 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.440945    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:03.451563 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:03.451461    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:06.560840 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.560799    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:06.577410 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.577385    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:06.587916 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.587889    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:06.647041 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.647017    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:06.657932 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.657900    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:06.669849 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.669821    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:06.693612 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.693575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:06.702747 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.702725    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:06.830015 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.829939    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:06.842132 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:06.842109    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:09.817710 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.817680    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:09.835376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.835344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:09.850323 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.850299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:09.911888 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.911860    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:09.923520 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.923497    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:09.935923 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.935895    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:09.957040 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.957016    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:09.964271 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:09.964250    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:10.077782 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:10.077670    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:10.087665 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:10.087644    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:13.171264 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.171236    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:13.189100 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.189071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:13.200512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.200480    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:13.251121 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.251090    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:13.264798 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.264748    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:13.277665 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.277639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:13.299976 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.299950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:13.306673 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.306648    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:13.464424 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.464343    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:13.485442 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:13.485414    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:16.535679 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.535647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:16.555466 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.555435    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:16.566689 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.566665    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:16.614298 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.614269    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:16.624965 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.624939    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:16.635635 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.635609    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:16.656277 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.656251    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:16.665473 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.665451    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:16.809080 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.809000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:16.827909 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:16.827884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:19.820819 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.820785    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:19.840893 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.840856    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:19.851483 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.851453    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:19.903408 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.903374    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:19.918376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.918350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:19.929740 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.929716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:19.951308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.951284    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:19.963071 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:19.963047    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:20.072115 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:20.072004    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:20.085117 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:20.085086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:23.165417 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.165378    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:23.185420 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.185388    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:23.200783 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.200725    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:23.256199 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.256170    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:23.267749 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.267722    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:23.280999 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.280964    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:23.302473 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.302447    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:23.313299 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.313271    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:23.442573 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.442494    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:23.465243 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:23.465184    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:26.343209 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.343170    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:26.360267 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.360239    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:26.371809 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.371784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:26.424375 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.424342    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:26.433337 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.433303    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:26.447404 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.447378    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:26.476208 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.476171    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:26.483130 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.483108    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:26.589624 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.589596    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:26.601297 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:26.601205    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:29.501386 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.501357    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:29.519064 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.519039    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:29.530362 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.530336    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:29.580541 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.580516    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:29.591361 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.591337    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:29.603120 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.603094    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:29.624742 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.624719    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:29.634796 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.634757    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:29.747308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.747274    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:29.758477 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:29.758369    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:32.620727 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.620697    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:32.644826 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.644796    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:32.659458 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.659419    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:32.709131 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.709098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:32.718611 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.718587    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:32.730232 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.730206    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:32.752142 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.752107    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:32.759517 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.759490    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:32.877465 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.877388    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:32.888806 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:32.888778    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:35.856014 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:35.855984    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:35.875821 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:35.875794    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:35.890921 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:35.890899    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:35.947753 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:35.947722    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:35.958385 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:35.958361    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:35.971644 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:35.971618    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:35.998894 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:35.998867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:36.009483 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:36.009462    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:36.136421 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:36.136346    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:36.150114 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:36.150084    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:39.236041 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.236011    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:39.253352 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.253321    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:39.264652 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.264627    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:39.318365 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.318338    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:39.329819 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.329792    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:39.341220 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.341183    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:39.363593 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.363568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:39.373128 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.373100    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:39.482198 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.482170    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:39.494325 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:39.494279    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:42.635873 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.635838    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:42.655411 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.655384    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:42.667709 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.667677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:42.726092 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.726065    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:42.738783 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.738748    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:42.750385 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.750358    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:42.775883 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.775852    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:42.790583 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.790557    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:42.900673 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.900593    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:42.914584 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:42.914546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:45.841904 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.841868    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:45.856597 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.856560    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:45.867972 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.867947    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:45.920298 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.920254    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:45.931401 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.931376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:45.943343 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.943320    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:45.965061 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.965034    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:45.974311 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:45.974283    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:46.088795 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:46.088747    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:46.101081 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:46.101001    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:48.352462 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:48.352429    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-596f9_5c16d266-24a7-4ee1-8619-4482c84755d7/discovery/0.log"
Jul 08 08:34:48.411637 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:48.411608    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f844d7bc-p2zxg_4d20e8ee-3269-4aad-ac44-e297ea819934/router/0.log"
Jul 08 08:34:50.633452 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.633424    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:50.651512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.651478    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:50.663537 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.663517    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:50.727264 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.727234    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:50.742574 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.742545    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:50.752798 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.752756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:50.775585 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.775555    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:50.794479 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.794453    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:50.901782 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.901680    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:50.918818 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:50.918792    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:53.960747 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:53.960705    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:53.980072 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:53.980045    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:53.995435 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:53.995416    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:54.058584 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:54.058555    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:54.070039 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:54.070014    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:54.085517 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:54.085490    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:54.116169 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:54.116128    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:54.127952 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:54.127926    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:54.253339 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:54.253308    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:54.271135 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:54.271109    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:34:57.207604 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.207575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:34:57.223027 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.223005    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:34:57.233876 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.233855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:34:57.285088 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.285062    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:34:57.294939 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.294910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:34:57.305258 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.305234    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:34:57.325974 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.325951    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:34:57.335297 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.335268    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:34:57.453593 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.453568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:34:57.471032 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:34:57.470957    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:35:00.438016 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.437984    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:35:00.454626 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.454602    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:35:00.468599 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.468572    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:35:00.529637 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.529611    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:35:00.542204 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.542173    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:35:00.554616 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.554591    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:35:00.580567 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.580539    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:35:00.597175 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.597147    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:35:00.749311 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.749242    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:35:00.762891 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:00.762863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:35:03.960121 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:03.960042    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:35:03.982242 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:03.982220    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:35:03.994522 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:03.994499    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:35:04.051226 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:04.051184    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:35:04.063037 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:04.063004    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:35:04.075743 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:04.075719    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:35:04.098323 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:04.098279    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:35:04.108148 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:04.108116    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:35:04.221645 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:04.221546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:35:04.233788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:04.233751    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:35:07.253718 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.253687    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schem2lrz_e303ae4c-c54e-4b1f-b3d5-ef3a1457c985/main/0.log"
Jul 08 08:35:07.272723 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.272687    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/main/0.log"
Jul 08 08:35:07.283230 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.283206    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sched2rsl_f5902ce4-f2d8-4f73-9f5f-7e3576c09c21/storage-initializer/0.log"
Jul 08 08:35:07.338472 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.338446    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/main/0.log"
Jul 08 08:35:07.348007 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.347983    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/llm-d-routing-sidecar/0.log"
Jul 08 08:35:07.359588 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.359567    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-6978d748b8-9ssnf_6a8bb147-65b6-4266-9e9e-e69ffc0d2c74/storage-initializer/0.log"
Jul 08 08:35:07.382121 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.382096    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/main/0.log"
Jul 08 08:35:07.389952 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.389909    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-pd-test-kserve-prefill-56559b5fdf-jgcng_9c57983a-88f5-4615-9e6b-8bafc4a48dfa/storage-initializer/0.log"
Jul 08 08:35:07.497332 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.497278    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/main/0.log"
Jul 08 08:35:07.511289 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:07.511187    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-with-refs-test-kserve-router-scheduler-74dd96b744-vhbc5_8bfbfa7a-932a-42cf-a283-e8a193a5a671/storage-initializer/0.log"
Jul 08 08:35:09.761314 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:09.761253    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-596f9_5c16d266-24a7-4ee1-8619-4482c84755d7/discovery/0.log"
Jul 08 08:35:09.825448 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:09.825419    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f844d7bc-p2zxg_4d20e8ee-3269-4aad-ac44-e297ea819934/router/0.log"
Jul 08 08:35:11.378331 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:11.378301    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-596f9_5c16d266-24a7-4ee1-8619-4482c84755d7/discovery/0.log"
Jul 08 08:35:11.450479 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:11.450447    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f844d7bc-p2zxg_4d20e8ee-3269-4aad-ac44-e297ea819934/router/0.log"
Jul 08 08:35:12.955234 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:12.955178    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-596f9_5c16d266-24a7-4ee1-8619-4482c84755d7/discovery/0.log"
Jul 08 08:35:13.022642 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:13.022600    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f844d7bc-p2zxg_4d20e8ee-3269-4aad-ac44-e297ea819934/router/0.log"
Jul 08 08:35:14.045917 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:14.045855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:14.062136 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:14.062108    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:14.432548 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:14.432465    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:14.446718 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:14.446688    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:15.477813 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:15.477734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:15.493258 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:15.493228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:15.867081 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:15.867042    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:15.885688 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:15.885658    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:16.928292 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:16.928267    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:16.942889 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:16.942858    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:17.368864 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:17.368833    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:17.386233 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:17.386208    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:18.473047 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:18.473023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:18.491155 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:18.491130    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:18.871635 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:18.871601    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:18.887044 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:18.887015    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:19.892470 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:19.892429    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:19.910210 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:19.910176    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:20.308356 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:20.308325    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:20.327198 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:20.327172    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:21.381708 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:21.381656    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:21.398353 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:21.398322    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:21.774612 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:21.774568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:21.791500 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:21.791472    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:22.825873 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:22.825839    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:22.850377 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:22.850330    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:23.286697 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:23.286664    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:23.344677 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:23.344647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:24.343740 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:24.343708    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:24.357512 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:24.357486    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:24.740846 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:24.740822    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:24.755838 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:24.755812    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:25.762107 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:25.762073    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:25.774874 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:25.774849    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:26.152605 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:26.152526    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:26.168835 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:26.168758    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:27.152544 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:27.152500    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:27.168366 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:27.168344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:27.551386 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:27.551355    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:27.566376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:27.566350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:28.557574 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:28.557522    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:28.571629 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:28.571599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:28.964465 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:28.964381    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:29.003182 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:29.003147    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:30.059108 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:30.059077    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:30.073280 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:30.073256    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:30.422888 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:30.422807    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:30.440845 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:30.440821    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:31.472750 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:31.472716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:31.487997 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:31.487972    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:31.865897 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:31.865864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:31.883408 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:31.883363    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:32.900371 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:32.900343    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:32.914551 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:32.914524    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:33.297264 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:33.297225    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:33.312825 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:33.312794    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:34.358790 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:34.355716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:34.373405 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:34.373372    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:34.744083 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:34.744048    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:34.760758 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:34.760731    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:35.794374 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:35.794344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:35.810087 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:35.810064    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:36.192316 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:36.192234    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:36.208024 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:36.207997    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:37.218969 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:37.218938    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:37.233823 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:37.233798    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:37.613780 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:37.613738    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:37.628655 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:37.628631    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:38.655398 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:38.655369    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:38.669889 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:38.669860    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:39.029807 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:39.029757    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:39.047336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:39.047303    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:40.050617 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:40.050585    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:40.072505 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:40.072481    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:40.455523 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:40.455440    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:40.473157 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:40.473131    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:41.553751 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:41.553722    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:41.567573 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:41.567544    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:41.956883 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:41.956803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:41.972373 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:41.972339    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:43.006014 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:43.005981    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:43.019262 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:43.019232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:43.400462 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:43.400377    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:43.416602 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:43.416565    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:44.421336 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:44.421306    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:44.439638 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:44.439609    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:44.830134 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:44.830110    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:44.848202 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:44.848160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:45.860607 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:45.860575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:45.873748 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:45.873715    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:46.244299 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:46.244276    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:46.260947 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:46.260912    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:47.283697 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:47.283663    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:47.298954 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:47.298932    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:47.691739 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:47.691649    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:47.707581 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:47.707557    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:48.744993 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:48.744969    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:48.759906 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:48.759880    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:49.145268 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:49.145184    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:49.161837 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:49.161809    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:50.162663 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:50.162634    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:50.178210 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:50.178187    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:50.564433 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:50.564403    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:50.583200 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:50.583175    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:51.564503 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:51.564478    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:51.586308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:51.586283    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:51.962910 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:51.962825    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:51.982786 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:51.982737    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:52.973481 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:52.973452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:52.988848 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:52.988821    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:53.357053 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:53.357023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:53.372491 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:53.372460    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:54.407788 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:54.407736    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:54.423391 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:54.423368    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:54.817945 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:54.817916    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:54.834258 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:54.834233    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:55.873991 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:55.873963    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:55.888354 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:55.888331    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:56.260968 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:56.260942    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:56.277693 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:56.277661    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:57.305146 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:57.305117    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:57.319161 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:57.319134    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:57.690670 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:57.690597    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:57.732283 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:57.732259    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:35:58.776493 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:58.776461    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:35:58.790385 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:58.790360    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:35:59.173410 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:59.173318    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:35:59.188914 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:35:59.188888    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:00.222561 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:00.222531    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:00.238527 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:00.238497    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:00.606900 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:00.606867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:00.623664 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:00.623632    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:01.683477 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:01.683451    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:01.711686 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:01.711662    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:02.135183 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:02.135157    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:02.165717 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:02.165684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:03.263255 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:03.263228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:03.293819 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:03.293748    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:03.694347 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:03.694257    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:03.710233 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:03.710207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:04.716238 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:04.716210    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:04.730159 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:04.730131    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:05.117805 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:05.117777    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:05.139813 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:05.139790    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:06.144483 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:06.144450    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:06.160237 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:06.160214    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:06.548972 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:06.548947    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:06.566563 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:06.566540    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:07.558018 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:07.557989    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:07.572476 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:07.572453    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:07.957453 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:07.957366    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:07.973471 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:07.973447    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:09.036095 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:09.036070    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:09.049020 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:09.048976    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:09.437479 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:09.437402    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:09.453027 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:09.453000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:10.460837 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:10.460793    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:10.476416 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:10.476391    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:10.837230 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:10.837201    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:10.853567 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:10.853538    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:11.889507 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:11.889475    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:11.904564 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:11.904539    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:12.273696 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:12.273667    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:12.290647 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:12.290624    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:13.339209 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:13.339181    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:13.357347 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:13.357317    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:13.758381 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:13.758355    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:13.781230 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:13.781205    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:14.819391 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:14.819358    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:14.832633 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:14.832609    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:15.232174 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:15.232098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:15.252558 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:15.252514    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:16.262700 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:16.262652    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:16.276958 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:16.276935    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:16.674503 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:16.674418    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:16.689153 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:16.689129    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:17.785945 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:17.785914    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:17.803887 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:17.803860    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:18.174954 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:18.174863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:18.190125 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:18.190101    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:19.195824 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:19.195787    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:19.210817 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:19.210791    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:19.576396 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:19.576371    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:19.593005 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:19.592979    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:20.594629 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:20.594598    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:20.608295 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:20.608275    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:20.984010 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:20.983928    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:20.999835 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:20.999807    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:21.998971 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:21.998941    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:22.013927 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:22.013898    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:22.365975 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:22.365899    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:22.390339 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:22.390310    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:23.421435 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:23.421392    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:23.439643 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:23.439621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:23.797008 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:23.796978    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:23.814854 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:23.814829    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:24.887949 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:24.887914    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:24.904454 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:24.904431    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:25.296226 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:25.296196    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:25.311913 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:25.311889    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:26.341666 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:26.341637    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:26.355674 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:26.355652    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:26.725480 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:26.725401    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:26.744010 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:26.743984    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:27.776690 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:27.776662    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:27.791531 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:27.791502    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:28.185649 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:28.185559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:28.201330 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:28.201305    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:29.215207 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:29.215179    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:29.229615 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:29.229588    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:29.596408 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:29.596377    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:29.612038 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:29.612016    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:30.615651 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:30.615616    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:30.633404 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:30.633375    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:31.013270 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:31.013246    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:31.031583 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:31.031556    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:32.072879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:32.072851    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:32.089473 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:32.089445    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:32.476577 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:32.476500    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:32.492702 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:32.492626    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:33.515063 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:33.515032    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:33.530330 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:33.530306    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:33.911976 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:33.911893    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:33.926822 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:33.926791    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:34.954595 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:34.954565    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:34.968354 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:34.968316    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:35.356297 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:35.356265    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:35.372695 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:35.372675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:36.404912 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:36.404885    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:36.419214 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:36.419185    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:36.802974 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:36.802946    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:36.819000 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:36.818968    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:37.866054 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:37.866028    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:37.880260 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:37.880232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:38.229529 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:38.229456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:38.246171 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:38.246141    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:39.274889 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:39.274860    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:39.288176 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:39.288154    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:39.686308 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:39.686218    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:39.700804 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:39.700777    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:40.718343 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:40.718311    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:40.733300 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:40.733271    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:41.144701 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:41.144661    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:41.162699 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:41.162673    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:42.193367 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:42.193343    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:42.207074 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:42.207047    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:42.583848 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:42.583807    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:42.602609 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:42.602583    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:48.592261 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:48.592232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hqdlr_afe5e80d-238d-47b2-8461-4df860065087/global-pull-secret-syncer/0.log"
Jul 08 08:36:48.751412 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:48.751381    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sshz7_4575f08e-0a3d-4124-962b-43eec74a3a43/konnectivity-agent/0.log"
Jul 08 08:36:48.832380 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:48.832352    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-129.ec2.internal_a7d9af3fb9e5661f42d636439856e61e/haproxy/0.log"
Jul 08 08:36:54.825910 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:54.825829    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-g2z8f_d44bc792-ede6-4270-9efa-10f86c2ce01d/manager/0.log"
Jul 08 08:36:54.898061 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:54.898033    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-p6hz9_016089e7-2b19-435e-bfe0-dddf6a666ce7/manager/0.log"
Jul 08 08:36:55.407441 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:55.407406    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-q5lkg_a46afd3e-4f24-487d-8037-bd42eb7899ca/limitador/0.log"
Jul 08 08:36:55.448330 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:55.448299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-xglwg_3888a24c-eb3e-4edd-86a2-396a3d90767e/manager/0.log"
Jul 08 08:36:57.002067 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.002042    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bhstp_c0c37e1f-2159-4423-b520-b5a69ddb16b1/kube-state-metrics/0.log"
Jul 08 08:36:57.046904 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.046878    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bhstp_c0c37e1f-2159-4423-b520-b5a69ddb16b1/kube-rbac-proxy-main/0.log"
Jul 08 08:36:57.085018 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.084991    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bhstp_c0c37e1f-2159-4423-b520-b5a69ddb16b1/kube-rbac-proxy-self/0.log"
Jul 08 08:36:57.182964 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.182931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-vnppc_a895408b-f55b-495d-b677-5e4dc9d4dc81/monitoring-plugin/0.log"
Jul 08 08:36:57.356638 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.356605    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sp64_96b09796-5465-4b4c-9491-7b1fd5f07aa8/node-exporter/0.log"
Jul 08 08:36:57.387818 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.387792    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sp64_96b09796-5465-4b4c-9491-7b1fd5f07aa8/kube-rbac-proxy/0.log"
Jul 08 08:36:57.411314 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.411283    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sp64_96b09796-5465-4b4c-9491-7b1fd5f07aa8/init-textfile/0.log"
Jul 08 08:36:57.545625 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.545530    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-c797f_39563fe0-e0ab-40fe-b584-2d0e5540646b/kube-rbac-proxy-main/0.log"
Jul 08 08:36:57.570447 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.570418    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-c797f_39563fe0-e0ab-40fe-b584-2d0e5540646b/kube-rbac-proxy-self/0.log"
Jul 08 08:36:57.599056 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:57.599031    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-c797f_39563fe0-e0ab-40fe-b584-2d0e5540646b/openshift-state-metrics/0.log"
Jul 08 08:36:58.098696 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:58.098668    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79668bd5f-rrqnk_9e64d53f-76aa-4a08-8da4-3f1f552d54d7/thanos-query/0.log"
Jul 08 08:36:58.123231 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:58.123204    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79668bd5f-rrqnk_9e64d53f-76aa-4a08-8da4-3f1f552d54d7/kube-rbac-proxy-web/0.log"
Jul 08 08:36:58.161088 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:58.161062    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79668bd5f-rrqnk_9e64d53f-76aa-4a08-8da4-3f1f552d54d7/kube-rbac-proxy/0.log"
Jul 08 08:36:58.187705 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:58.187675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79668bd5f-rrqnk_9e64d53f-76aa-4a08-8da4-3f1f552d54d7/prom-label-proxy/0.log"
Jul 08 08:36:58.212311 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:58.212285    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79668bd5f-rrqnk_9e64d53f-76aa-4a08-8da4-3f1f552d54d7/kube-rbac-proxy-rules/0.log"
Jul 08 08:36:58.238906 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:36:58.238880    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79668bd5f-rrqnk_9e64d53f-76aa-4a08-8da4-3f1f552d54d7/kube-rbac-proxy-metrics/0.log"
Jul 08 08:37:00.152493 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.152458    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"]
Jul 08 08:37:00.152901 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.152880    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" containerName="manager"
Jul 08 08:37:00.152901 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.152892    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" containerName="manager"
Jul 08 08:37:00.152980 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.152911    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6994039b-7194-4f6b-ac10-755e870189a7" containerName="main"
Jul 08 08:37:00.152980 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.152916    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6994039b-7194-4f6b-ac10-755e870189a7" containerName="main"
Jul 08 08:37:00.153041 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.152980    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c00d02-8c9a-4190-ad2e-1d8f8d4b7fe1" containerName="manager"
Jul 08 08:37:00.153041 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.152991    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6994039b-7194-4f6b-ac10-755e870189a7" containerName="main"
Jul 08 08:37:00.156106 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.156084    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.158606 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.158587    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cc4px\"/\"openshift-service-ca.crt\""
Jul 08 08:37:00.159542 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.159523    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cc4px\"/\"kube-root-ca.crt\""
Jul 08 08:37:00.159650 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.159523    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cc4px\"/\"default-dockercfg-zzsrs\""
Jul 08 08:37:00.164563 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.164538    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"]
Jul 08 08:37:00.244376 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.244346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-sys\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.244566 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.244398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-podres\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.244566 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.244416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrfj2\" (UniqueName: \"kubernetes.io/projected/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-kube-api-access-mrfj2\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.244566 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.244435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-lib-modules\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.244566 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.244540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-proc\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345514 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-sys\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345704 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-podres\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345704 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345622    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-sys\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345704 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrfj2\" (UniqueName: \"kubernetes.io/projected/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-kube-api-access-mrfj2\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345704 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-lib-modules\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-proc\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345756    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-podres\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.345879 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345865    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-proc\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.346019 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.345909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-lib-modules\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.355327 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.355296    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrfj2\" (UniqueName: \"kubernetes.io/projected/7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126-kube-api-access-mrfj2\") pod \"perf-node-gather-daemonset-qmdqz\" (UID: \"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126\") " pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.468628 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.468524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:00.617819 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.617787    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"]
Jul 08 08:37:00.621186 ip-10-0-136-129 kubenswrapper[2573]: W0708 08:37:00.621155    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7d1d0d2c_98ca_44fb_bfe6_404f9f7d6126.slice/crio-346bfb3a23b4afc28e52637b457fe4ae147dd10beb786f7c85f0282f75c8921c WatchSource:0}: Error finding container 346bfb3a23b4afc28e52637b457fe4ae147dd10beb786f7c85f0282f75c8921c: Status 404 returned error can't find the container with id 346bfb3a23b4afc28e52637b457fe4ae147dd10beb786f7c85f0282f75c8921c
Jul 08 08:37:00.631637 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.631619    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-5wxsd_1e4a98b1-034b-4323-9659-bb39e3c91315/download-server/0.log"
Jul 08 08:37:00.658868 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:00.658820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz" event={"ID":"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126","Type":"ContainerStarted","Data":"346bfb3a23b4afc28e52637b457fe4ae147dd10beb786f7c85f0282f75c8921c"}
Jul 08 08:37:01.666429 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:01.666385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz" event={"ID":"7d1d0d2c-98ca-44fb-bfe6-404f9f7d6126","Type":"ContainerStarted","Data":"729cfbb045afc31b08d3fce072f3a36b68f0ea8b224b4e4f83a492d87c6d4d97"}
Jul 08 08:37:01.666898 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:01.666462    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:01.699925 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:01.699874    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz" podStartSLOduration=1.699857412 podStartE2EDuration="1.699857412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 08:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 08:37:01.697602758 +0000 UTC m=+6141.393123639" watchObservedRunningTime="2026-07-08 08:37:01.699857412 +0000 UTC m=+6141.395378318"
Jul 08 08:37:02.714280 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:02.714251    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxd2j_1a90417f-8479-4d53-aef4-55c0eb6ff45a/dns/0.log"
Jul 08 08:37:02.741551 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:02.741519    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxd2j_1a90417f-8479-4d53-aef4-55c0eb6ff45a/kube-rbac-proxy/0.log"
Jul 08 08:37:02.827807 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:02.827781    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vv587_0389afe8-f7d2-4543-93fd-03bbf7b422a5/dns-node-resolver/0.log"
Jul 08 08:37:03.466612 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:03.466568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b67c57f75-zlw9z_ba330f19-3a1f-40e1-885d-fdb6aa72b356/registry/0.log"
Jul 08 08:37:03.525581 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:03.525555    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gs6tq_ba6d7dae-f54d-49da-a43e-7623d1e7ce64/node-ca/0.log"
Jul 08 08:37:05.218069 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:05.218029    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-596f9_5c16d266-24a7-4ee1-8619-4482c84755d7/discovery/0.log"
Jul 08 08:37:05.461048 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:05.461008    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f844d7bc-p2zxg_4d20e8ee-3269-4aad-ac44-e297ea819934/router/0.log"
Jul 08 08:37:06.132129 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:06.132087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xkml7_69bc16c5-ea89-455b-8f34-02cb389ece14/serve-healthcheck-canary/0.log"
Jul 08 08:37:06.738466 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:06.738424    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhdpb_a45bcf29-6e71-4280-9525-84fac4d59374/kube-rbac-proxy/0.log"
Jul 08 08:37:06.760560 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:06.760535    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhdpb_a45bcf29-6e71-4280-9525-84fac4d59374/exporter/0.log"
Jul 08 08:37:06.785486 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:06.785461    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhdpb_a45bcf29-6e71-4280-9525-84fac4d59374/extractor/0.log"
Jul 08 08:37:07.681597 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:07.681571    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cc4px/perf-node-gather-daemonset-qmdqz"
Jul 08 08:37:13.107185 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:13.107153    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-596f9_5c16d266-24a7-4ee1-8619-4482c84755d7/discovery/0.log"
Jul 08 08:37:13.165205 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:13.165172    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f844d7bc-p2zxg_4d20e8ee-3269-4aad-ac44-e297ea819934/router/0.log"
Jul 08 08:37:14.855070 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:14.855039    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-596f9_5c16d266-24a7-4ee1-8619-4482c84755d7/discovery/0.log"
Jul 08 08:37:14.929708 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:14.929677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86f844d7bc-p2zxg_4d20e8ee-3269-4aad-ac44-e297ea819934/router/0.log"
Jul 08 08:37:17.831529 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:17.831502    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-445s9_8370199a-c475-488d-9044-106856cd7611/migrator/0.log"
Jul 08 08:37:17.859188 ip-10-0-136-129 kubenswrapper[2573]: I0708 08:37:17.859157    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-445s9_8370199a-c475-488d-9044-106856cd7611/graceful-termination/0.log"