Jul 01 20:46:33.197449 ip-10-0-132-117 systemd[1]: Starting Kubernetes Kubelet...
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.706139    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710759    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710770    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710774    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710778    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710781    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710785    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 20:46:34.782536 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710789    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710794    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710797    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710800    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710803    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710806    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710808    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710812    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710814    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710817    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710820    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710822    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710825    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710827    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710833    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710838    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710841    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710845    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710849    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 20:46:34.783633 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710852    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710854    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710857    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710860    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710863    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710866    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710869    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710871    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710874    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710878    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710881    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710883    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710886    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710889    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710891    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710894    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710898    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710901    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710904    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710907    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 20:46:34.784895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710910    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710913    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710915    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710918    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710921    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710923    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710926    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710928    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710930    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710933    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710936    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710939    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710941    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710944    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710947    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710951    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710954    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710957    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710959    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710962    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 20:46:34.785750 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710964    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710967    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710969    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710972    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710974    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710977    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710980    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710983    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710986    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.710988    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711004    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711007    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711010    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711013    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711016    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711019    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711021    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711024    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711027    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711029    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 20:46:34.786769 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711032    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711034    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711037    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711040    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711043    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711045    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711048    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711050    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711053    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711055    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711058    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711061    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711063    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711065    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711770    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711777    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711781    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711783    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711786    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711788    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 20:46:34.787645 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711791    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711794    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711797    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711799    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711802    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711808    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711810    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711813    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711816    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711818    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711821    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711825    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711829    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711832    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711837    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711840    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711843    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711846    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711849    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 20:46:34.788661 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711852    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711856    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711858    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711861    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711864    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711866    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711869    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711872    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711874    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711877    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711880    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711882    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711885    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711887    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711890    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711892    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711895    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711897    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711900    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711903    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 20:46:34.789281 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711905    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711908    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711910    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711913    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711916    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711919    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711922    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711926    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711929    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711931    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711934    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711937    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711939    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711942    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711944    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711947    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711949    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711952    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711954    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 20:46:34.790355 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711957    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711959    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711962    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711965    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711968    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711970    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711974    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711978    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711980    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711983    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711986    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.711989    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712009    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712012    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712015    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712017    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712020    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712023    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712026    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712028    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 20:46:34.791386 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712031    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712033    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712036    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712038    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712041    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712043    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712046    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712048    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712062    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712066    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712070    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712073    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712076    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712079    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712082    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712419    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712423    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712426    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712429    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712432    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 20:46:34.792259 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712434    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712437    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712440    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712443    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712445    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712448    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712451    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712454    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712456    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712459    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712461    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712464    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712466    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712469    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712472    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712475    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712477    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712480    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712483    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712486    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 20:46:34.793055 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712488    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712491    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712495    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712499    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712502    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712506    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712508    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712511    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712515    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712519    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712521    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712524    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712526    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712529    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712532    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712534    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712537    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712539    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712542    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 20:46:34.794274 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712545    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 20:46:34.794283 ip-10-0-132-117 systemd[1]: Started Kubernetes Kubelet.
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712547    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712550    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712552    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712554    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712557    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712563    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712566    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712568    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712571    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712573    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712576    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712579    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712582    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712584    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712587    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712589    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712592    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712594    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712597    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712600    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 20:46:34.795227 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712602    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712605    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712607    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712610    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712612    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712615    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712617    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712621    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712624    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712626    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712629    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712631    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712634    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712636    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712639    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712641    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712644    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712649    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712651    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712654    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 20:46:34.796094 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712657    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712661    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712665    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712668    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712670    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712673    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712676    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712679    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712682    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712685    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712687    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712690    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712693    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.712695    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712753    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712760    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712765    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712769    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712772    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712777    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 01 20:46:34.797132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712781    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712785    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712788    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712791    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712795    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712798    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712801    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712804    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712807    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712812    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712814    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712817    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712821    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712824    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712827    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712830    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712833    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712837    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712840    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712843    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712846    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712849    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712852    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712855    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 01 20:46:34.798615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712858    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712861    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712865    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712868    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712871    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712874    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712877    2569 flags.go:64] FLAG: --enable-server="true"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712881    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712884    2569 flags.go:64] FLAG: --event-burst="100"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712888    2569 flags.go:64] FLAG: --event-qps="50"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712891    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712894    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712896    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712903    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712906    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712909    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712912    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712917    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712919    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712922    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712925    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712928    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712931    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712934    2569 flags.go:64] FLAG: --feature-gates=""
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712937    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 01 20:46:34.799488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712940    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712943    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712947    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712949    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712952    2569 flags.go:64] FLAG: --help="false"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712955    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-132-117.ec2.internal"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712958    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712961    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712964    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712967    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712971    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712973    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712976    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712979    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712983    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712986    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.712989    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713005    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713009    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713011    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713014    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713018    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713021    2569 flags.go:64] FLAG: --lock-file=""
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713024    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 01 20:46:34.800499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713028    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713031    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713037    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713039    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713042    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713045    2569 flags.go:64] FLAG: --logging-format="text"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713048    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713051    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713054    2569 flags.go:64] FLAG: --manifest-url=""
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713057    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713062    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713065    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713068    2569 flags.go:64] FLAG: --max-pods="110"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713072    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713074    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713077    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713080    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713083    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713086    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713088    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713095    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713098    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713102    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 01 20:46:34.801382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713105    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713108    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713113    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713116    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713119    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713122    2569 flags.go:64] FLAG: --port="10250"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713125    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713129    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-047c4f9cd95f91e21"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713132    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713135    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713139    2569 flags.go:64] FLAG: --register-node="true"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713142    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713146    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713148    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713151    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713154    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713162    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713165    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713168    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713171    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713173    2569 flags.go:64] FLAG: --runonce="false"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713176    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713179    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713182    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713185    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 01 20:46:34.802603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713188    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713191    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713194    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713197    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713200    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713203    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713207    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713210    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713213    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713216    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713218    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713223    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713226    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713229    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713233    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713236    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713239    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713243    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713246    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713248    2569 flags.go:64] FLAG: --v="2"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713252    2569 flags.go:64] FLAG: --version="false"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713256    2569 flags.go:64] FLAG: --vmodule=""
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713259    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713263    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713369    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 20:46:34.803431 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713373    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713376    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713379    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713382    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713384    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713387    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713389    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713392    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713394    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713397    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713399    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713402    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713404    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713408    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713411    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713413    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713415    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713418    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713421    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713423    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 20:46:34.804471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713426    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713428    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713431    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713434    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713438    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713440    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713443    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713445    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713448    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713450    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713453    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713458    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713461    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713464    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713467    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713470    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713473    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713475    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713478    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713481    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 20:46:34.805106 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713483    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713486    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713488    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713491    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713493    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713497    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713500    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713503    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713506    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713511    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713516    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713520    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713526    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713531    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713535    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713538    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713543    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713546    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713549    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713552    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 20:46:34.806424 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713554    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713557    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713559    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713562    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713565    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713567    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713570    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713573    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713575    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713578    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713580    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713583    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713586    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713588    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713591    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713593    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713596    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713600    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713603    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713605    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 20:46:34.807489 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713608    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713618    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713621    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713623    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713626    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713629    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713631    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713634    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713639    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713642    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713645    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713648    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713650    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713653    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713655    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713658    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713661    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 20:46:34.808518 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.713663    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.713669    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.730174    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.730193    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.730213    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.730219    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730274    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730278    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730282    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730285    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730289    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730293    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730296    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730299    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 20:46:34.809364 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730303    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730306    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730309    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730312    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730315    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730318    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730321    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730323    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730326    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730328    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730331    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730334    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730337    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730352    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730355    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730358    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730361    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730364    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730367    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 20:46:34.809983 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730370    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730374    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730378    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730381    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730384    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730387    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730391    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730394    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730397    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730399    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730402    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730405    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730408    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730410    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730413    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730416    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730419    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730421    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730424    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730426    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 20:46:34.810607 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730429    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730432    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730434    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730437    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730440    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730443    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730446    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730448    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730451    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730453    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730457    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730464    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730467    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730470    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730472    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730475    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730478    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730480    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730483    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730486    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 20:46:34.811349 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730488    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730491    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730494    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730497    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730499    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730502    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730504    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730507    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730510    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730512    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730515    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730518    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730521    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730524    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730526    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730529    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730532    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730534    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730537    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730540    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 20:46:34.812398 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730543    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730545    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730548    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730554    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730557    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730560    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730562    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730566    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730570    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730573    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730576    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730579    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.730583    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730695    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 20:46:34.881788 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730701    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730704    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730707    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730710    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730712    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730715    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730718    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730720    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730723    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730725    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730728    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730731    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730734    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730737    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730739    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730742    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730745    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730748    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730750    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730756    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 20:46:34.882539 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730759    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730763    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730766    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730770    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730773    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730776    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730779    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730781    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730784    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730787    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730789    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730792    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730795    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730797    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730800    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730802    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730805    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730807    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730810    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 20:46:34.883910 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730812    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730815    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730819    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730822    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730825    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730829    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730832    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730835    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730838    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730841    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730844    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730846    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730850    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730853    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730857    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730859    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730862    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730865    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730867    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730870    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 20:46:34.884599 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730872    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730875    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730877    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730880    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730883    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730885    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730888    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730890    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730893    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730895    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730898    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730902    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730905    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730908    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730911    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730914    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730917    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730920    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730923    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730926    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 20:46:34.885428 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730929    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730931    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730934    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730936    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730940    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730943    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730946    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730949    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730952    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730955    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730957    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730960    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730962    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730965    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730967    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730970    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730973    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730975    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 20:46:34.886276 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:34.730978    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.730983    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.731104    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.733128    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.735188    2569 server.go:1019] "Starting client certificate rotation"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.735297    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.736046    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.737797    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.739873    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.758215    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.760248    2569 log.go:25] "Validated CRI v1 image API"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.762096    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 01 20:46:34.887085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.765764    2569 fs.go:135] Filesystem UUIDs: map[40347a6c-3f7c-4cf4-a487-2eb285c95df1:/dev/nvme0n1p4 5079e6ef-7a1f-46f2-b974-f6b27a605fd3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 01 20:46:34.887532 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.765783    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 01 20:46:34.887663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.773800    2569 manager.go:216] Machine: {Timestamp:2026-07-01 20:46:34.772425623 +0000 UTC m=+0.368311928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3133225 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a4dbb10d63e61eda30e9ccf9491e SystemUUID:ec24a4db-b10d-63e6-1eda-30e9ccf9491e BootID:9982e2dc-310c-4839-8d54-1fad7d470aeb Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:95:f1:ff:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:95:f1:ff:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:46:00:95:07:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 01 20:46:34.887663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.773947    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 01 20:46:34.887663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.774049    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 01 20:46:34.887663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.774682    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 20:46:34.887663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.777210    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 01 20:46:34.887663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.777236    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 01 20:46:34.887663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.778042    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.778197    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.778205    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.778897    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.779726    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.782699    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.782843    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.782876    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.782888    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.782906    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.782926    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.782938    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.783427    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.783453    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.785544    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.787083    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.787126    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788432    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788453    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788461    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788467    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788478    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788485    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788495    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788502    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788510    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788516    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788526    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.788535    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.789294    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.789308    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.793373    2569 server.go:1268] "Started kubelet"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.793396    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.793481    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.793559    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.794797    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.796211    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.797267    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.797268    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 01 20:46:34.887937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.797272    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.799164    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18be45632feb0b0f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-07-01 20:46:34.793306895 +0000 UTC m=+0.389193200,LastTimestamp:2026-07-01 20:46:34.793306895 +0000 UTC m=+0.389193200,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.800833    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.801460    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d9z6l"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.801664    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.802042    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.803871    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.804598    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.804606    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.804771    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.804827    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.804834    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.806518    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.806663    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807028    2569 factory.go:55] Registering systemd factory
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807040    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807301    2569 factory.go:153] Registering CRI-O factory
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807325    2569 factory.go:223] Registration of the crio container factory successfully
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807370    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807387    2569 factory.go:103] Registering Raw factory
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807398    2569 manager.go:1196] Started watching for new ooms in manager
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.807786    2569 manager.go:349] Starting recovery of all containers
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.811152    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d9z6l"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.844550    2569 manager.go:354] Recovery completed
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.849474    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.851257    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.851280    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.851294    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.851956    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.851964    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.851978    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.853104    2569 policy_none.go:49] "None policy: Start"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.853115    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.853125    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 01 20:46:34.890061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.854352    2569 policy_none.go:47] "Start"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.854856    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.855428    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.855449    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.855462    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.889623    2569 manager.go:337] "Starting Device Plugin manager"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.889701    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.889728    2569 server.go:87] "Starting device plugin registration server"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.890035    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.890049    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.890235    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.890299    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.890307    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.890772    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 01 20:46:34.891306 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.890829    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:34.962084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.957101    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 01 20:46:34.962084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.958529    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 01 20:46:34.962084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.958558    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 01 20:46:34.962084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.958577    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 01 20:46:34.962084 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:34.958613    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 01 20:46:34.962084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.961105    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.990483    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.991806    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.991826    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.991837    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:34.991859    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.000874    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.000891    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-117.ec2.internal\": node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.045829    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.058927    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"]
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.058989    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.060642    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.060662    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.060670    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.061905    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062050    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062077    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062605    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062620    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062628    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062805    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062815    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.062823    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.064124    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.064142    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.064707    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.064723    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 20:46:35.071762 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.064732    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID"
Jul 01 20:46:35.177452 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.103632    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.177452 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.107893    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.177452 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.146505    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.267779 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.211455    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5a7fba88e577d35de7ce0228e637b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"ad5a7fba88e577d35de7ce0228e637b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.267779 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.211487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01d09e4c13117ae1e640b3f5a139e135-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"01d09e4c13117ae1e640b3f5a139e135\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.267779 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.211504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad5a7fba88e577d35de7ce0228e637b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"ad5a7fba88e577d35de7ce0228e637b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.267779 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.247013    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.369851 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.317193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad5a7fba88e577d35de7ce0228e637b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"ad5a7fba88e577d35de7ce0228e637b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.369851 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.317249    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5a7fba88e577d35de7ce0228e637b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"ad5a7fba88e577d35de7ce0228e637b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.369851 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.317284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01d09e4c13117ae1e640b3f5a139e135-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"01d09e4c13117ae1e640b3f5a139e135\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.369851 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.317288    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad5a7fba88e577d35de7ce0228e637b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"ad5a7fba88e577d35de7ce0228e637b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.369851 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.317314    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01d09e4c13117ae1e640b3f5a139e135-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"01d09e4c13117ae1e640b3f5a139e135\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.369851 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.317343    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5a7fba88e577d35de7ce0228e637b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"ad5a7fba88e577d35de7ce0228e637b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.369851 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.347296    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.407825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.407810    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.411758 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.411743    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:35.448180 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.448136    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.548591 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.548559    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.649006 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.648979    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.733485 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.733427    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 01 20:46:35.733573 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.733560    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 20:46:35.749712 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.749696    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.815786 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.815759    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 20:41:34 +0000 UTC" deadline="2028-03-04 11:52:26.312504568 +0000 UTC"
Jul 01 20:46:35.815786 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.815783    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14679h5m50.496724412s"
Jul 01 20:46:35.850181 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.850164    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.950841 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:35.950814    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:35.957707 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:35.957686    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 20:46:36.049356 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.049294    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 20:46:36.051265 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.051245    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found"
Jul 01 20:46:36.060135 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:36.060105    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d09e4c13117ae1e640b3f5a139e135.slice/crio-31bef9bf8a847b76b4283039b08fe29a975acee7947e4f7836bfd044a07dbb5f WatchSource:0}: Error finding container 31bef9bf8a847b76b4283039b08fe29a975acee7947e4f7836bfd044a07dbb5f: Status 404 returned error can't find the container with id 31bef9bf8a847b76b4283039b08fe29a975acee7947e4f7836bfd044a07dbb5f
Jul 01 20:46:36.060804 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:36.060779    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5a7fba88e577d35de7ce0228e637b2.slice/crio-ab8a7c480bca49fa9ac059d276ad4a4878654c3fa9e7915c0815e296708ab7ff WatchSource:0}: Error finding container ab8a7c480bca49fa9ac059d276ad4a4878654c3fa9e7915c0815e296708ab7ff: Status 404 returned error can't find the container with id ab8a7c480bca49fa9ac059d276ad4a4878654c3fa9e7915c0815e296708ab7ff
Jul 01 20:46:36.066745 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.066730    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 20:46:36.068285 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.068269    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 20:46:36.105641 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.105624    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:36.116507 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.116494    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 20:46:36.117510 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.117499    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"
Jul 01 20:46:36.124216 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.124204    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 20:46:36.606121 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.606088    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 20:46:36.784074 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.784049    2569 apiserver.go:52] "Watching apiserver"
Jul 01 20:46:36.790213 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.790190    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 01 20:46:36.790747 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.790723    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-772qp","openshift-image-registry/node-ca-jjncf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal","openshift-multus/multus-additional-cni-plugins-vrktm","kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal","openshift-multus/multus-ksggx","openshift-multus/network-metrics-daemon-xw4rh","openshift-network-diagnostics/network-check-target-6gj4t","openshift-network-operator/iptables-alerter-tfqlz","openshift-ovn-kubernetes/ovnkube-node-q2zrq","kube-system/global-pull-secret-syncer-bfr9n","kube-system/konnectivity-agent-bl2jh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm","openshift-cluster-node-tuning-operator/tuned-tml2k"]
Jul 01 20:46:36.792382 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.792363    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:36.792482 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.792452    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:36.793548 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.793525    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.793662 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.793598    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:36.794732 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.794713    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.796141 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.796121    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.797395 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.797373    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:36.797482 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.797441    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:36.798617 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.798546    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4nc2v\""
Jul 01 20:46:36.798708 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.798679    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 01 20:46:36.798833 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.798765    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 01 20:46:36.799046 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.799027    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f5r6k\""
Jul 01 20:46:36.799250 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.799234    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.800204 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.800029    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 01 20:46:36.800204 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.800108    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 01 20:46:36.800366 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.800330    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 01 20:46:36.800527 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.800507    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 01 20:46:36.800633 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.800614    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 01 20:46:36.801147 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.800831    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.801282 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.801264    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 01 20:46:36.801352 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.801339    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lnwpp\""
Jul 01 20:46:36.801957 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.801939    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.803131 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.802768    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 01 20:46:36.803131 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.802873    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 01 20:46:36.803131 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.802984    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 01 20:46:36.803485 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.803464    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2stvp\""
Jul 01 20:46:36.803597 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.803581    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.804013 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.803705    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 01 20:46:36.804218 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.804161    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 01 20:46:36.804336 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.804161    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 01 20:46:36.804336 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.804319    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p5m62\""
Jul 01 20:46:36.805228 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.804606    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 01 20:46:36.806912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.806264    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.806912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.806856    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 01 20:46:36.809634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.807840    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 01 20:46:36.809634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.807866    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bmr8d\""
Jul 01 20:46:36.809634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.808713    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 01 20:46:36.809634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.808721    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 01 20:46:36.809881 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.809712    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x6mpj\""
Jul 01 20:46:36.809881 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.809749    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 01 20:46:36.810855 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.810051    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 01 20:46:36.812721 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.811298    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 01 20:46:36.812721 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.811521    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 01 20:46:36.812721 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.811696    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 01 20:46:36.812721 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.812220    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:36.814329 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.814309    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 01 20:46:36.814476 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.814457    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c8hxm\""
Jul 01 20:46:36.814690 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.814508    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 01 20:46:36.815114 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.815097    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:36.815828 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.815632    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 20:46:36.817170 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.817023    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 01 20:46:36.817170 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.817122    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 01 20:46:36.817321 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.817269    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zb6pl\""
Jul 01 20:46:36.827124 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-socket-dir-parent\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.827224 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827137    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-device-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.827224 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-lib-modules\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.827224 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce9e4b91-55a4-4842-872d-d99848bb2a02-iptables-alerter-script\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.827369 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827238    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e340c04-4bde-41fc-b23e-1aa34ce58284-host\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.827369 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827265    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qlfj\" (UniqueName: \"kubernetes.io/projected/e3f536c1-9066-494e-be39-2a69df7f8e3d-kube-api-access-4qlfj\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.827369 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827299    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cnibin\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.827369 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xjj\" (UniqueName: \"kubernetes.io/projected/92b6045c-3ba1-4406-9849-211cd833cdee-kube-api-access-m2xjj\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.827531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827366    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-sys\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.827531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-slash\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.827531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827416    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-run-netns\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.827531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cni-binary-copy\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.827531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827485    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.827531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-socket-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827552    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-systemd-units\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827574    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92b6045c-3ba1-4406-9849-211cd833cdee-cni-binary-copy\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-cni-multus\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827619    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6th4\" (UniqueName: \"kubernetes.io/projected/4bbe856a-007f-4829-add8-0d49859c4df7-kube-api-access-x6th4\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c387588e-1425-467f-93a2-7642036e59fb-tmp\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-kubelet\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.827785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827742    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-env-overrides\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827791    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysctl-d\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb5zv\" (UniqueName: \"kubernetes.io/projected/ce9e4b91-55a4-4842-872d-d99848bb2a02-kube-api-access-qb5zv\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e340c04-4bde-41fc-b23e-1aa34ce58284-serviceca\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.827986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-etc-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovnkube-config\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-hostroot\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828123    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tpjx\" (UniqueName: \"kubernetes.io/projected/c3e54d2b-8773-4f7d-9591-4985550c948b-kube-api-access-2tpjx\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828149    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovnkube-script-lib\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.828175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-os-release\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828223    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-etc-kubernetes\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828264    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdj5s\" (UniqueName: \"kubernetes.io/projected/c387588e-1425-467f-93a2-7642036e59fb-kube-api-access-zdj5s\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-systemd\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-cni-netd\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828410    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-k8s-cni-cncf-io\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-cni-bin\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wxwt\" (UniqueName: \"kubernetes.io/projected/7e340c04-4bde-41fc-b23e-1aa34ce58284-kube-api-access-5wxwt\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828480    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-kubelet\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828582    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-registration-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-sys-fs\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828639    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-kubernetes\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.828710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828670    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-ovn\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828693    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-log-socket\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-multus-certs\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a5942d3-fea9-4fab-b135-20321b55466f-dbus\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-systemd\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828816    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-cni-bin\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovn-node-metrics-cert\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-system-cni-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828957    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-conf-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.828980    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysctl-conf\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-run\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829056    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-system-cni-dir\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829078    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:36.829393 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829106    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysconfig\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829130    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-var-lib-kubelet\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829172    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c387588e-1425-467f-93a2-7642036e59fb-etc-tuned\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92b6045c-3ba1-4406-9849-211cd833cdee-multus-daemon-config\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829377    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829407    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-cni-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a5942d3-fea9-4fab-b135-20321b55466f-kubelet-config\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-modprobe-d\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-var-lib-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-node-log\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829578    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-host\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-cnibin\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.830027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-netns\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.830702 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829675    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce9e4b91-55a4-4842-872d-d99848bb2a02-host-slash\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.830702 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssx54\" (UniqueName: \"kubernetes.io/projected/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-kube-api-access-ssx54\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.830702 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.829722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-os-release\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.839602 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.839583    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wzqvk"
Jul 01 20:46:36.847873 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.847850    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wzqvk"
Jul 01 20:46:36.905775 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.905749    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 01 20:46:36.930634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930549    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1278a623-a288-481b-840c-34fe79ed2c4e-konnectivity-ca\") pod \"konnectivity-agent-bl2jh\" (UID: \"1278a623-a288-481b-840c-34fe79ed2c4e\") " pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:36.930634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysctl-d\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.930634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930615    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb5zv\" (UniqueName: \"kubernetes.io/projected/ce9e4b91-55a4-4842-872d-d99848bb2a02-kube-api-access-qb5zv\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.930832 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e340c04-4bde-41fc-b23e-1aa34ce58284-serviceca\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.930832 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-etc-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.930832 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovnkube-config\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.930832 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930775    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysctl-d\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.930832 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930789    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-hostroot\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.930832 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930815    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930824    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-etc-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930840    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tpjx\" (UniqueName: \"kubernetes.io/projected/c3e54d2b-8773-4f7d-9591-4985550c948b-kube-api-access-2tpjx\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovnkube-script-lib\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930883    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-hostroot\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-os-release\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-etc-kubernetes\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.930959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdj5s\" (UniqueName: \"kubernetes.io/projected/c387588e-1425-467f-93a2-7642036e59fb-kube-api-access-zdj5s\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.931149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-systemd\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-cni-netd\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931200    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-k8s-cni-cncf-io\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931260    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-os-release\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931257    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-k8s-cni-cncf-io\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931287    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7e340c04-4bde-41fc-b23e-1aa34ce58284-serviceca\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.931317    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931341    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-etc-kubernetes\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931328    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931371    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-cni-bin\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931380    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-cni-netd\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.931400    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs podName:4bbe856a-007f-4829-add8-0d49859c4df7 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:37.431366207 +0000 UTC m=+3.027252510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs") pod "network-metrics-daemon-xw4rh" (UID: "4bbe856a-007f-4829-add8-0d49859c4df7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931399    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-systemd\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931412    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-cni-bin\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.931562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0fd629a-699a-419f-b1a1-f92355487075-tmp-dir\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931471    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wxwt\" (UniqueName: \"kubernetes.io/projected/7e340c04-4bde-41fc-b23e-1aa34ce58284-kube-api-access-5wxwt\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-kubelet\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931585    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-registration-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-sys-fs\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931623    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovnkube-config\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931625    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-kubelet\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931636    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-kubernetes\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931680    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-ovn\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-kubernetes\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931697    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-registration-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-log-socket\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931713    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-sys-fs\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.932225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931748    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-log-socket\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931813    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931812    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-multus-certs\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a5942d3-fea9-4fab-b135-20321b55466f-dbus\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931847    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-multus-certs\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931780    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-ovn\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931875    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0fd629a-699a-419f-b1a1-f92355487075-hosts-file\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-systemd\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931943    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-cni-bin\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovn-node-metrics-cert\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.931985    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-systemd\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-system-cni-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-conf-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932062    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovnkube-script-lib\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.932872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932080    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a5942d3-fea9-4fab-b135-20321b55466f-dbus\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932099    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-cni-bin\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932141    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-system-cni-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932212    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-conf-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932309    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysctl-conf\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932105    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysctl-conf\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-run\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-system-cni-dir\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932674    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysconfig\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932708    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-run\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932708    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-var-lib-kubelet\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932707    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-system-cni-dir\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.933618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c387588e-1425-467f-93a2-7642036e59fb-etc-tuned\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932772    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-var-lib-kubelet\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932819    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-sysconfig\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932893    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92b6045c-3ba1-4406-9849-211cd833cdee-multus-daemon-config\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.932947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-cni-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933037    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a5942d3-fea9-4fab-b135-20321b55466f-kubelet-config\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-modprobe-d\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933083    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-cni-dir\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933092    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-var-lib-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-node-log\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933185    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-var-lib-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.933203    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933212    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55ftw\" (UniqueName: \"kubernetes.io/projected/b0fd629a-699a-419f-b1a1-f92355487075-kube-api-access-55ftw\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:36.934324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933242    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-run-openvswitch\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933293    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-node-log\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933322    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-host\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933340    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a5942d3-fea9-4fab-b135-20321b55466f-kubelet-config\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933404    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-host\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933416    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-etc-modprobe-d\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.933451    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret podName:8a5942d3-fea9-4fab-b135-20321b55466f nodeName:}" failed. No retries permitted until 2026-07-01 20:46:37.43339694 +0000 UTC m=+3.029283232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret") pod "global-pull-secret-syncer-bfr9n" (UID: "8a5942d3-fea9-4fab-b135-20321b55466f") : object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933463    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92b6045c-3ba1-4406-9849-211cd833cdee-multus-daemon-config\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-cnibin\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933571    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933573    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-netns\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933588    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-cnibin\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933619    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-run-netns\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce9e4b91-55a4-4842-872d-d99848bb2a02-host-slash\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssx54\" (UniqueName: \"kubernetes.io/projected/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-kube-api-access-ssx54\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933686    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce9e4b91-55a4-4842-872d-d99848bb2a02-host-slash\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933689    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-os-release\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933725    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-os-release\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933755    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-socket-dir-parent\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-device-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933869    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-device-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933885    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-multus-socket-dir-parent\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933948    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-lib-modules\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.933981    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce9e4b91-55a4-4842-872d-d99848bb2a02-iptables-alerter-script\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e340c04-4bde-41fc-b23e-1aa34ce58284-host\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934062    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qlfj\" (UniqueName: \"kubernetes.io/projected/e3f536c1-9066-494e-be39-2a69df7f8e3d-kube-api-access-4qlfj\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934085    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-lib-modules\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934134    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e340c04-4bde-41fc-b23e-1aa34ce58284-host\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.935720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934154    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cnibin\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cnibin\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xjj\" (UniqueName: \"kubernetes.io/projected/92b6045c-3ba1-4406-9849-211cd833cdee-kube-api-access-m2xjj\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934249    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-sys\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-slash\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-run-netns\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cni-binary-copy\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934358    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-socket-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934424    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-slash\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-systemd-units\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92b6045c-3ba1-4406-9849-211cd833cdee-cni-binary-copy\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-cni-multus\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6th4\" (UniqueName: \"kubernetes.io/projected/4bbe856a-007f-4829-add8-0d49859c4df7-kube-api-access-x6th4\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:36.936440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c387588e-1425-467f-93a2-7642036e59fb-tmp\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-kubelet\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-env-overrides\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934667    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c387588e-1425-467f-93a2-7642036e59fb-sys\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934670    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce9e4b91-55a4-4842-872d-d99848bb2a02-iptables-alerter-script\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934728    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-run-netns\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934714    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1278a623-a288-481b-840c-34fe79ed2c4e-agent-certs\") pod \"konnectivity-agent-bl2jh\" (UID: \"1278a623-a288-481b-840c-34fe79ed2c4e\") " pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934838    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92b6045c-3ba1-4406-9849-211cd833cdee-host-var-lib-cni-multus\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934873    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-kubelet\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.934920    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.935032    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-socket-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.935088    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3e54d2b-8773-4f7d-9591-4985550c948b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.937136 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.935270    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3f536c1-9066-494e-be39-2a69df7f8e3d-env-overrides\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937765 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.935349    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-cni-binary-copy\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.937765 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.935425    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3f536c1-9066-494e-be39-2a69df7f8e3d-systemd-units\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937765 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.935630    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.937765 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.935661    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92b6045c-3ba1-4406-9849-211cd833cdee-cni-binary-copy\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.937765 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.936820    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3f536c1-9066-494e-be39-2a69df7f8e3d-ovn-node-metrics-cert\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.937765 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.937674    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c387588e-1425-467f-93a2-7642036e59fb-tmp\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.938051 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.937864    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c387588e-1425-467f-93a2-7642036e59fb-etc-tuned\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.940755 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.940674    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb5zv\" (UniqueName: \"kubernetes.io/projected/ce9e4b91-55a4-4842-872d-d99848bb2a02-kube-api-access-qb5zv\") pod \"iptables-alerter-tfqlz\" (UID: \"ce9e4b91-55a4-4842-872d-d99848bb2a02\") " pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:36.940849 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.940757    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tpjx\" (UniqueName: \"kubernetes.io/projected/c3e54d2b-8773-4f7d-9591-4985550c948b-kube-api-access-2tpjx\") pod \"aws-ebs-csi-driver-node-wrnpm\" (UID: \"c3e54d2b-8773-4f7d-9591-4985550c948b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:36.940954 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.940929    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 20:46:36.941127 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.941115    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 20:46:36.941229 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.941220    2569 projected.go:196] Error preparing data for projected volume kube-api-access-d4ph5 for pod openshift-network-diagnostics/network-check-target-6gj4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:36.942287 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:36.942244    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5 podName:66b431e3-36ab-4c51-b88d-1337ae631aab nodeName:}" failed. No retries permitted until 2026-07-01 20:46:37.442223858 +0000 UTC m=+3.038110170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d4ph5" (UniqueName: "kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5") pod "network-check-target-6gj4t" (UID: "66b431e3-36ab-4c51-b88d-1337ae631aab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:36.942607 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.942587    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdj5s\" (UniqueName: \"kubernetes.io/projected/c387588e-1425-467f-93a2-7642036e59fb-kube-api-access-zdj5s\") pod \"tuned-tml2k\" (UID: \"c387588e-1425-467f-93a2-7642036e59fb\") " pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:36.943149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.943102    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wxwt\" (UniqueName: \"kubernetes.io/projected/7e340c04-4bde-41fc-b23e-1aa34ce58284-kube-api-access-5wxwt\") pod \"node-ca-jjncf\" (UID: \"7e340c04-4bde-41fc-b23e-1aa34ce58284\") " pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:36.946188 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.946168    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6th4\" (UniqueName: \"kubernetes.io/projected/4bbe856a-007f-4829-add8-0d49859c4df7-kube-api-access-x6th4\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:36.948019 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.947976    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssx54\" (UniqueName: \"kubernetes.io/projected/d6b95b10-440c-4b19-a5d3-5a98c20ddb49-kube-api-access-ssx54\") pod \"multus-additional-cni-plugins-vrktm\" (UID: \"d6b95b10-440c-4b19-a5d3-5a98c20ddb49\") " pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:36.948422 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.948400    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xjj\" (UniqueName: \"kubernetes.io/projected/92b6045c-3ba1-4406-9849-211cd833cdee-kube-api-access-m2xjj\") pod \"multus-ksggx\" (UID: \"92b6045c-3ba1-4406-9849-211cd833cdee\") " pod="openshift-multus/multus-ksggx"
Jul 01 20:46:36.949506 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.949489    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qlfj\" (UniqueName: \"kubernetes.io/projected/e3f536c1-9066-494e-be39-2a69df7f8e3d-kube-api-access-4qlfj\") pod \"ovnkube-node-q2zrq\" (UID: \"e3f536c1-9066-494e-be39-2a69df7f8e3d\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:36.964216 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.964171    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"ad5a7fba88e577d35de7ce0228e637b2","Type":"ContainerStarted","Data":"ab8a7c480bca49fa9ac059d276ad4a4878654c3fa9e7915c0815e296708ab7ff"}
Jul 01 20:46:36.965736 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:36.965714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"01d09e4c13117ae1e640b3f5a139e135","Type":"ContainerStarted","Data":"31bef9bf8a847b76b4283039b08fe29a975acee7947e4f7836bfd044a07dbb5f"}
Jul 01 20:46:37.035449 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.035414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55ftw\" (UniqueName: \"kubernetes.io/projected/b0fd629a-699a-419f-b1a1-f92355487075-kube-api-access-55ftw\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:37.035575 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.035477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1278a623-a288-481b-840c-34fe79ed2c4e-agent-certs\") pod \"konnectivity-agent-bl2jh\" (UID: \"1278a623-a288-481b-840c-34fe79ed2c4e\") " pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:37.035575 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.035503    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1278a623-a288-481b-840c-34fe79ed2c4e-konnectivity-ca\") pod \"konnectivity-agent-bl2jh\" (UID: \"1278a623-a288-481b-840c-34fe79ed2c4e\") " pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:37.035575 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.035552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0fd629a-699a-419f-b1a1-f92355487075-tmp-dir\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:37.035734 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.035585    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0fd629a-699a-419f-b1a1-f92355487075-hosts-file\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:37.035734 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.035680    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0fd629a-699a-419f-b1a1-f92355487075-hosts-file\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:37.036053 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.035987    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0fd629a-699a-419f-b1a1-f92355487075-tmp-dir\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:37.036247 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.036219    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1278a623-a288-481b-840c-34fe79ed2c4e-konnectivity-ca\") pod \"konnectivity-agent-bl2jh\" (UID: \"1278a623-a288-481b-840c-34fe79ed2c4e\") " pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:37.038490 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.038468    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1278a623-a288-481b-840c-34fe79ed2c4e-agent-certs\") pod \"konnectivity-agent-bl2jh\" (UID: \"1278a623-a288-481b-840c-34fe79ed2c4e\") " pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:37.043761 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.043733    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55ftw\" (UniqueName: \"kubernetes.io/projected/b0fd629a-699a-419f-b1a1-f92355487075-kube-api-access-55ftw\") pod \"node-resolver-772qp\" (UID: \"b0fd629a-699a-419f-b1a1-f92355487075\") " pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:37.113891 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.113823    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tml2k"
Jul 01 20:46:37.121897 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.121864    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vrktm"
Jul 01 20:46:37.129622 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.129575    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ksggx"
Jul 01 20:46:37.137328 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.137301    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tfqlz"
Jul 01 20:46:37.146051 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.146033    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm"
Jul 01 20:46:37.153725 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.153707    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjncf"
Jul 01 20:46:37.160400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.160385    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:46:37.167166 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.167150    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-772qp"
Jul 01 20:46:37.174232 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.174214    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:46:37.438939 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.438861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:37.439112 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.439027    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:37.439112 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.439058    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:37.439244 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.439126    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:37.439244 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.439159    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret podName:8a5942d3-fea9-4fab-b135-20321b55466f nodeName:}" failed. No retries permitted until 2026-07-01 20:46:38.439138522 +0000 UTC m=+4.035024819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret") pod "global-pull-secret-syncer-bfr9n" (UID: "8a5942d3-fea9-4fab-b135-20321b55466f") : object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:37.439244 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.439182    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs podName:4bbe856a-007f-4829-add8-0d49859c4df7 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:38.439170791 +0000 UTC m=+4.035057087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs") pod "network-metrics-daemon-xw4rh" (UID: "4bbe856a-007f-4829-add8-0d49859c4df7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:37.539977 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.539939    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:37.540144 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.540110    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 20:46:37.540144 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.540132    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 20:46:37.540144 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.540142    2569 projected.go:196] Error preparing data for projected volume kube-api-access-d4ph5 for pod openshift-network-diagnostics/network-check-target-6gj4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:37.540268 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:37.540194    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5 podName:66b431e3-36ab-4c51-b88d-1337ae631aab nodeName:}" failed. No retries permitted until 2026-07-01 20:46:38.540180752 +0000 UTC m=+4.136067046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4ph5" (UniqueName: "kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5") pod "network-check-target-6gj4t" (UID: "66b431e3-36ab-4c51-b88d-1337ae631aab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:37.849756 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.849677    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:41:36 +0000 UTC" deadline="2027-11-29 09:24:11.79583835 +0000 UTC"
Jul 01 20:46:37.849756 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:37.849709    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12372h37m33.94613242s"
Jul 01 20:46:38.000079 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.000050    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fd629a_699a_419f_b1a1_f92355487075.slice/crio-5225452cc439b31f70f2f868547efa76677ce50eb04fbd9426120a58bc1b738d WatchSource:0}: Error finding container 5225452cc439b31f70f2f868547efa76677ce50eb04fbd9426120a58bc1b738d: Status 404 returned error can't find the container with id 5225452cc439b31f70f2f868547efa76677ce50eb04fbd9426120a58bc1b738d
Jul 01 20:46:38.001691 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.001666    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1278a623_a288_481b_840c_34fe79ed2c4e.slice/crio-4fbf0fca814a96ecd3644915a05d74e15d14e9685c16f18f458ba6754984909f WatchSource:0}: Error finding container 4fbf0fca814a96ecd3644915a05d74e15d14e9685c16f18f458ba6754984909f: Status 404 returned error can't find the container with id 4fbf0fca814a96ecd3644915a05d74e15d14e9685c16f18f458ba6754984909f
Jul 01 20:46:38.005170 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.005148    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b6045c_3ba1_4406_9849_211cd833cdee.slice/crio-53d8d585b6f9e642e64a573b293b27f837b18b064c6003475411a9b587c80695 WatchSource:0}: Error finding container 53d8d585b6f9e642e64a573b293b27f837b18b064c6003475411a9b587c80695: Status 404 returned error can't find the container with id 53d8d585b6f9e642e64a573b293b27f837b18b064c6003475411a9b587c80695
Jul 01 20:46:38.006686 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.006650    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9e4b91_55a4_4842_872d_d99848bb2a02.slice/crio-64c9ba5c29a2bf2c9cc01240df6828d2087d135b8600b773072724b0347bec12 WatchSource:0}: Error finding container 64c9ba5c29a2bf2c9cc01240df6828d2087d135b8600b773072724b0347bec12: Status 404 returned error can't find the container with id 64c9ba5c29a2bf2c9cc01240df6828d2087d135b8600b773072724b0347bec12
Jul 01 20:46:38.007487 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.007393    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e54d2b_8773_4f7d_9591_4985550c948b.slice/crio-a60ce34af012a4f1c143495c3e4d435dc4be98553e4415a32a41ceda549e8bd8 WatchSource:0}: Error finding container a60ce34af012a4f1c143495c3e4d435dc4be98553e4415a32a41ceda549e8bd8: Status 404 returned error can't find the container with id a60ce34af012a4f1c143495c3e4d435dc4be98553e4415a32a41ceda549e8bd8
Jul 01 20:46:38.008853 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.008808    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f536c1_9066_494e_be39_2a69df7f8e3d.slice/crio-27e00f7400e61126cdc6bd84ab598c8399d077dc9b5e2cb331313a017755bdb2 WatchSource:0}: Error finding container 27e00f7400e61126cdc6bd84ab598c8399d077dc9b5e2cb331313a017755bdb2: Status 404 returned error can't find the container with id 27e00f7400e61126cdc6bd84ab598c8399d077dc9b5e2cb331313a017755bdb2
Jul 01 20:46:38.009775 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.009733    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b95b10_440c_4b19_a5d3_5a98c20ddb49.slice/crio-dd97ba49d6c943987690c88a1eff97c9ae1a2c89991747a0434199a9419f8765 WatchSource:0}: Error finding container dd97ba49d6c943987690c88a1eff97c9ae1a2c89991747a0434199a9419f8765: Status 404 returned error can't find the container with id dd97ba49d6c943987690c88a1eff97c9ae1a2c89991747a0434199a9419f8765
Jul 01 20:46:38.010102 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.009981    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc387588e_1425_467f_93a2_7642036e59fb.slice/crio-52f140a344bd7201e29d3d22f029f368db431e3d82fcc12775200478bfad8675 WatchSource:0}: Error finding container 52f140a344bd7201e29d3d22f029f368db431e3d82fcc12775200478bfad8675: Status 404 returned error can't find the container with id 52f140a344bd7201e29d3d22f029f368db431e3d82fcc12775200478bfad8675
Jul 01 20:46:38.012534 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:46:38.012493    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e340c04_4bde_41fc_b23e_1aa34ce58284.slice/crio-dd64f4faa9cb3fbfdeefb60f5ac9dfa02a81dd0b4de83408ed3d72a019b63bfb WatchSource:0}: Error finding container dd64f4faa9cb3fbfdeefb60f5ac9dfa02a81dd0b4de83408ed3d72a019b63bfb: Status 404 returned error can't find the container with id dd64f4faa9cb3fbfdeefb60f5ac9dfa02a81dd0b4de83408ed3d72a019b63bfb
Jul 01 20:46:38.448061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.447367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:38.448061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.447487    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:38.448061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.447678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:38.448061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.447756    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs podName:4bbe856a-007f-4829-add8-0d49859c4df7 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:40.44772648 +0000 UTC m=+6.043612770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs") pod "network-metrics-daemon-xw4rh" (UID: "4bbe856a-007f-4829-add8-0d49859c4df7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:38.448061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.447792    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:38.448061 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.447848    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret podName:8a5942d3-fea9-4fab-b135-20321b55466f nodeName:}" failed. No retries permitted until 2026-07-01 20:46:40.447832581 +0000 UTC m=+6.043718878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret") pod "global-pull-secret-syncer-bfr9n" (UID: "8a5942d3-fea9-4fab-b135-20321b55466f") : object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:38.549015 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.548919    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:38.549169 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.549105    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 20:46:38.549169 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.549127    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 20:46:38.549169 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.549140    2569 projected.go:196] Error preparing data for projected volume kube-api-access-d4ph5 for pod openshift-network-diagnostics/network-check-target-6gj4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:38.549322 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.549196    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5 podName:66b431e3-36ab-4c51-b88d-1337ae631aab nodeName:}" failed. No retries permitted until 2026-07-01 20:46:40.549177796 +0000 UTC m=+6.145064090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4ph5" (UniqueName: "kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5") pod "network-check-target-6gj4t" (UID: "66b431e3-36ab-4c51-b88d-1337ae631aab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:38.850825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.850738    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:41:36 +0000 UTC" deadline="2027-12-08 13:29:49.339994107 +0000 UTC"
Jul 01 20:46:38.850825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.850797    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12592h43m10.489200376s"
Jul 01 20:46:38.962631 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.961793    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:38.962631 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.961927    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:38.962631 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.962323    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:38.962631 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.962408    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:38.962631 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.962461    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:38.962631 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:38.962525    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:38.976511 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.976478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bl2jh" event={"ID":"1278a623-a288-481b-840c-34fe79ed2c4e","Type":"ContainerStarted","Data":"4fbf0fca814a96ecd3644915a05d74e15d14e9685c16f18f458ba6754984909f"}
Jul 01 20:46:38.989176 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.989088    2569 generic.go:356] "Generic (PLEG): container finished" podID="ad5a7fba88e577d35de7ce0228e637b2" containerID="a393a839e6584821c6f00e22618a3a620a715b480dbf12a2337acfd45f628fe5" exitCode=0
Jul 01 20:46:38.989176 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:38.989162    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"ad5a7fba88e577d35de7ce0228e637b2","Type":"ContainerDied","Data":"a393a839e6584821c6f00e22618a3a620a715b480dbf12a2337acfd45f628fe5"}
Jul 01 20:46:39.012170 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.012115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"01d09e4c13117ae1e640b3f5a139e135","Type":"ContainerStarted","Data":"113735b8a26e3ac1108f6555e9bfaa9ef5f9fc65141701510669e0940fa0f6d5"}
Jul 01 20:46:39.031766 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.031708    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjncf" event={"ID":"7e340c04-4bde-41fc-b23e-1aa34ce58284","Type":"ContainerStarted","Data":"dd64f4faa9cb3fbfdeefb60f5ac9dfa02a81dd0b4de83408ed3d72a019b63bfb"}
Jul 01 20:46:39.044152 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.044028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"27e00f7400e61126cdc6bd84ab598c8399d077dc9b5e2cb331313a017755bdb2"}
Jul 01 20:46:39.059365 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.059339    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ksggx" event={"ID":"92b6045c-3ba1-4406-9849-211cd833cdee","Type":"ContainerStarted","Data":"53d8d585b6f9e642e64a573b293b27f837b18b064c6003475411a9b587c80695"}
Jul 01 20:46:39.069453 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.069389    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-772qp" event={"ID":"b0fd629a-699a-419f-b1a1-f92355487075","Type":"ContainerStarted","Data":"5225452cc439b31f70f2f868547efa76677ce50eb04fbd9426120a58bc1b738d"}
Jul 01 20:46:39.085282 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.085224    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tml2k" event={"ID":"c387588e-1425-467f-93a2-7642036e59fb","Type":"ContainerStarted","Data":"52f140a344bd7201e29d3d22f029f368db431e3d82fcc12775200478bfad8675"}
Jul 01 20:46:39.089457 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.089432    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerStarted","Data":"dd97ba49d6c943987690c88a1eff97c9ae1a2c89991747a0434199a9419f8765"}
Jul 01 20:46:39.101053 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.101007    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm" event={"ID":"c3e54d2b-8773-4f7d-9591-4985550c948b","Type":"ContainerStarted","Data":"a60ce34af012a4f1c143495c3e4d435dc4be98553e4415a32a41ceda549e8bd8"}
Jul 01 20:46:39.127470 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:39.127248    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tfqlz" event={"ID":"ce9e4b91-55a4-4842-872d-d99848bb2a02","Type":"ContainerStarted","Data":"64c9ba5c29a2bf2c9cc01240df6828d2087d135b8600b773072724b0347bec12"}
Jul 01 20:46:40.149890 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.149858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"ad5a7fba88e577d35de7ce0228e637b2","Type":"ContainerStarted","Data":"dfc7d9e6f816060b80dfe7e7ac54bdf54dd2e56869b0a7d63e1efe1ecdcd9c1f"}
Jul 01 20:46:40.164475 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.164418    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" podStartSLOduration=4.16439885 podStartE2EDuration="4.16439885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:40.164209751 +0000 UTC m=+5.760096066" watchObservedRunningTime="2026-07-01 20:46:40.16439885 +0000 UTC m=+5.760285163"
Jul 01 20:46:40.164677 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.164649    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" podStartSLOduration=4.164639272 podStartE2EDuration="4.164639272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:39.027849465 +0000 UTC m=+4.623735779" watchObservedRunningTime="2026-07-01 20:46:40.164639272 +0000 UTC m=+5.760525587"
Jul 01 20:46:40.469639 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.469547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:40.469805 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.469637    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:40.469871 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.469820    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:40.469927 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.469884    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret podName:8a5942d3-fea9-4fab-b135-20321b55466f nodeName:}" failed. No retries permitted until 2026-07-01 20:46:44.469865029 +0000 UTC m=+10.065751329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret") pod "global-pull-secret-syncer-bfr9n" (UID: "8a5942d3-fea9-4fab-b135-20321b55466f") : object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:40.470295 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.470275    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:40.470400 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.470334    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs podName:4bbe856a-007f-4829-add8-0d49859c4df7 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:44.470316251 +0000 UTC m=+10.066202547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs") pod "network-metrics-daemon-xw4rh" (UID: "4bbe856a-007f-4829-add8-0d49859c4df7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:40.570722 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.570682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:40.570906 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.570869    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 20:46:40.570967 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.570914    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 20:46:40.570967 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.570927    2569 projected.go:196] Error preparing data for projected volume kube-api-access-d4ph5 for pod openshift-network-diagnostics/network-check-target-6gj4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:40.571090 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.570982    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5 podName:66b431e3-36ab-4c51-b88d-1337ae631aab nodeName:}" failed. No retries permitted until 2026-07-01 20:46:44.570964346 +0000 UTC m=+10.166850644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4ph5" (UniqueName: "kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5") pod "network-check-target-6gj4t" (UID: "66b431e3-36ab-4c51-b88d-1337ae631aab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:40.962767 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.962092    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:40.962767 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.962203    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:40.962767 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.962570    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:40.962767 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.962665    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:40.963372 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:40.963232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:40.963372 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:40.963329    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:42.959021 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:42.958907    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:42.959521 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:42.959058    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:42.959521 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:42.959458    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:42.959644 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:42.959561    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:42.959730 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:42.959695    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:42.959855 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:42.959773    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:44.505776 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:44.505576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:44.505776 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:44.505674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:44.506306 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.505810    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:44.506306 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.505839    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:44.506306 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.505876    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs podName:4bbe856a-007f-4829-add8-0d49859c4df7 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:52.505858161 +0000 UTC m=+18.101744455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs") pod "network-metrics-daemon-xw4rh" (UID: "4bbe856a-007f-4829-add8-0d49859c4df7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:44.506306 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.505907    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret podName:8a5942d3-fea9-4fab-b135-20321b55466f nodeName:}" failed. No retries permitted until 2026-07-01 20:46:52.505888965 +0000 UTC m=+18.101775263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret") pod "global-pull-secret-syncer-bfr9n" (UID: "8a5942d3-fea9-4fab-b135-20321b55466f") : object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:44.607510 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:44.606881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:44.607510 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.607074    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 20:46:44.607510 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.607094    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 20:46:44.607510 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.607106    2569 projected.go:196] Error preparing data for projected volume kube-api-access-d4ph5 for pod openshift-network-diagnostics/network-check-target-6gj4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:44.607510 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.607168    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5 podName:66b431e3-36ab-4c51-b88d-1337ae631aab nodeName:}" failed. No retries permitted until 2026-07-01 20:46:52.607150444 +0000 UTC m=+18.203036742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4ph5" (UniqueName: "kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5") pod "network-check-target-6gj4t" (UID: "66b431e3-36ab-4c51-b88d-1337ae631aab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:44.960101 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:44.959985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:44.960273 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.960123    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:44.960273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:44.960132    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:44.960273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:44.960163    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:44.960273 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.960211    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:44.960273 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:44.960269    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:46.959910 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:46.959552    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:46.959910 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:46.959703    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:46.959910 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:46.959559    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:46.959910 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:46.959814    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:46.959910 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:46.959551    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:46.959910 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:46.959879    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:48.959554 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:48.959521    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:48.959953 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:48.959527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:48.959953 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:48.959640    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:48.959953 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:48.959653    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:48.959953 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:48.959758    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:48.959953 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:48.959859    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:50.959054 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:50.959020    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:50.959482 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:50.959059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:50.959482 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:50.959022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:50.959482 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:50.959150    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:50.959482 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:50.959231    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:50.959482 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:50.959301    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:52.568812 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:52.568780    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:52.569247 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:52.568833    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:52.569247 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.568914    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:52.569247 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.568918    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:52.569247 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.568961    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret podName:8a5942d3-fea9-4fab-b135-20321b55466f nodeName:}" failed. No retries permitted until 2026-07-01 20:47:08.568947582 +0000 UTC m=+34.164833873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret") pod "global-pull-secret-syncer-bfr9n" (UID: "8a5942d3-fea9-4fab-b135-20321b55466f") : object "kube-system"/"original-pull-secret" not registered
Jul 01 20:46:52.569247 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.568975    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs podName:4bbe856a-007f-4829-add8-0d49859c4df7 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:08.568968133 +0000 UTC m=+34.164854424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs") pod "network-metrics-daemon-xw4rh" (UID: "4bbe856a-007f-4829-add8-0d49859c4df7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:46:52.669833 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:52.669804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:52.670010 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.669928    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 20:46:52.670010 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.669947    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 20:46:52.670010 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.669956    2569 projected.go:196] Error preparing data for projected volume kube-api-access-d4ph5 for pod openshift-network-diagnostics/network-check-target-6gj4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:52.670139 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.670012    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5 podName:66b431e3-36ab-4c51-b88d-1337ae631aab nodeName:}" failed. No retries permitted until 2026-07-01 20:47:08.669986398 +0000 UTC m=+34.265872690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4ph5" (UniqueName: "kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5") pod "network-check-target-6gj4t" (UID: "66b431e3-36ab-4c51-b88d-1337ae631aab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:46:52.959485 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:52.959424    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:52.959485 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:52.959443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:52.959690 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:52.959422    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:52.959690 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.959530    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:52.959690 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.959576    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:52.959690 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:52.959635    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:54.960108 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:54.960065    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:54.960550 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:54.960172    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:54.960550 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:54.960194    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:54.960550 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:54.960210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:54.960550 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:54.960321    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:54.960550 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:54.960407    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:56.960630 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:56.959782    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:56.960630 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:56.960020    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:56.960630 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:56.960111    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:56.960630 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:56.960249    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:56.960630 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:56.959949    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:56.960630 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:56.960347    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:57.184362 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.184330    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bl2jh" event={"ID":"1278a623-a288-481b-840c-34fe79ed2c4e","Type":"ContainerStarted","Data":"80202e3962cc628fcd89b0006490c56ab17b6a4edd959fb58e78fddfb16ff0fd"}
Jul 01 20:46:57.186050 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.186022    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjncf" event={"ID":"7e340c04-4bde-41fc-b23e-1aa34ce58284","Type":"ContainerStarted","Data":"b62a210fc1cc4473768be0e41de8a2335752bd8e4740618c4aa78dabe7b0c75f"}
Jul 01 20:46:57.187902 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.187884    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:46:57.188260 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.188241    2569 generic.go:356] "Generic (PLEG): container finished" podID="e3f536c1-9066-494e-be39-2a69df7f8e3d" containerID="f843a4afe7d1bb0d45cce9b880f80accf70f1d4e1d1f27b21986b59923de4a4b" exitCode=1
Jul 01 20:46:57.188331 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.188302    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"09c213f1d8cce0f76b585b89a039a932bacb3fce8dcb271f9dccab9262bacc0d"}
Jul 01 20:46:57.188399 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.188381    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerDied","Data":"f843a4afe7d1bb0d45cce9b880f80accf70f1d4e1d1f27b21986b59923de4a4b"}
Jul 01 20:46:57.188466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.188436    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"ef2b48a24645fd8a9995f080e907b5e625d458fa821c465493847611eb85432f"}
Jul 01 20:46:57.189734 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.189710    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ksggx" event={"ID":"92b6045c-3ba1-4406-9849-211cd833cdee","Type":"ContainerStarted","Data":"9c5cff85878c0de8536b0f0bb04b8b308a920efc13a3f06e3a3a345ab31ae8fe"}
Jul 01 20:46:57.191201 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.191173    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-772qp" event={"ID":"b0fd629a-699a-419f-b1a1-f92355487075","Type":"ContainerStarted","Data":"d9120b90f064ca2dab473dc068ec1de05ea6c2d4e43630d899d284539417e592"}
Jul 01 20:46:57.192857 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.192691    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tml2k" event={"ID":"c387588e-1425-467f-93a2-7642036e59fb","Type":"ContainerStarted","Data":"17ed1ff7ab4f5d7486df703fe7e4463bb5c2cfdc4500fdea9b58117c7d054676"}
Jul 01 20:46:57.194213 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.194194    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b95b10-440c-4b19-a5d3-5a98c20ddb49" containerID="e2bb469087f54a68a7d29af5e9bfdbb80e3771c8ea9231de0c397fd5a6879fa8" exitCode=0
Jul 01 20:46:57.194309 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.194254    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerDied","Data":"e2bb469087f54a68a7d29af5e9bfdbb80e3771c8ea9231de0c397fd5a6879fa8"}
Jul 01 20:46:57.195744 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.195724    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm" event={"ID":"c3e54d2b-8773-4f7d-9591-4985550c948b","Type":"ContainerStarted","Data":"e5bf9996d5cdad8af3b146c1bb378fa65ba8f9087973f2681f59a85db890880e"}
Jul 01 20:46:57.209380 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.209342    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bl2jh" podStartSLOduration=3.526764643 podStartE2EDuration="22.209330545s" totalImagesPullingTime="18.682565902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:57.208770711 +0000 UTC m=+22.804657024" watchObservedRunningTime="2026-07-01 20:46:57.209330545 +0000 UTC m=+22.805216857"
Jul 01 20:46:57.262088 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.261951    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jjncf" podStartSLOduration=3.523785279 podStartE2EDuration="22.261935626s" totalImagesPullingTime="18.738150347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:57.240833201 +0000 UTC m=+22.836719514" watchObservedRunningTime="2026-07-01 20:46:57.261935626 +0000 UTC m=+22.857821937"
Jul 01 20:46:57.262654 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.262624    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tml2k" podStartSLOduration=3.520169952 podStartE2EDuration="22.26261205s" totalImagesPullingTime="18.742442098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:57.262608595 +0000 UTC m=+22.858494909" watchObservedRunningTime="2026-07-01 20:46:57.26261205 +0000 UTC m=+22.858498365"
Jul 01 20:46:57.303768 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.303745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:57.332912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.332877    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ksggx" podStartSLOduration=3.421591886 podStartE2EDuration="22.332863953s" totalImagesPullingTime="18.911272067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:57.312098403 +0000 UTC m=+22.907984716" watchObservedRunningTime="2026-07-01 20:46:57.332863953 +0000 UTC m=+22.928750266"
Jul 01 20:46:57.333309 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.333287    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-772qp" podStartSLOduration=3.6045044600000002 podStartE2EDuration="22.333279936s" totalImagesPullingTime="18.728775476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:57.332291985 +0000 UTC m=+22.928178297" watchObservedRunningTime="2026-07-01 20:46:57.333279936 +0000 UTC m=+22.929166249"
Jul 01 20:46:57.398490 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.398473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:57.499901 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.499827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:57.599897 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.599869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:57.679123 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:57.679097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:58.199533 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.199497    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tfqlz" event={"ID":"ce9e4b91-55a4-4842-872d-d99848bb2a02","Type":"ContainerStarted","Data":"ff2ede64a64b42b730bd201b99817fe243a3d7c5cbd5e09cc05bb91c874a182a"}
Jul 01 20:46:58.202663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.202644    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:46:58.203070 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.203044    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"d44b0f7bd91d244631f2919800ae9d0d17f6fa8a77a4fba109a4531cdda0b509"}
Jul 01 20:46:58.203160 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.203124    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"fad9cab1365eb15ce6cac4c8eef64848be5991d9fd9ef1a31aaf717d7224627f"}
Jul 01 20:46:58.203216 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.203169    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"809b106852d2f0e8a75ff2162f1ee2e7c1f4f575c2c47180759dbff6156a9e06"}
Jul 01 20:46:58.230477 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.230429    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tfqlz" podStartSLOduration=4.482414639 podStartE2EDuration="23.230413008s" totalImagesPullingTime="18.747998369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:58.230075518 +0000 UTC m=+23.825961843" watchObservedRunningTime="2026-07-01 20:46:58.230413008 +0000 UTC m=+23.826299321"
Jul 01 20:46:58.473651 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.473622    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 01 20:46:58.632723 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.632694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:58.904484 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.904328    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T20:46:58.473645343Z","UUID":"1b97cc28-b83c-4312-aecd-425883ff3b2e","Handler":null,"Name":"","Endpoint":""}
Jul 01 20:46:58.906011 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.905974    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 01 20:46:58.906124 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.906031    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 01 20:46:58.959593 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.959522    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:46:58.959593 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.959544    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:46:58.959789 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.959522    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:46:58.959789 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:58.959641    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:46:58.959789 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:58.959743    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:46:58.959949 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:46:58.959839    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:46:58.998912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:58.998886    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:59.203213 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:59.203137    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:59.207320 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:59.207279    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm" event={"ID":"c3e54d2b-8773-4f7d-9591-4985550c948b","Type":"ContainerStarted","Data":"a4954b7a4ce5db016d7b9f505bf9673b63a94d5faada3dfc190d7c1e740af14e"}
Jul 01 20:46:59.303510 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:59.303478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:59.456957 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:59.456883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:59.602318 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:59.602289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:46:59.700499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:46:59.700479    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:00.213413 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.213233    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:47:00.213823 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.213742    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"63ed75dd6ef3698fca33ff184d5a0612f823b42abe9da90fde044919910fa510"}
Jul 01 20:47:00.620914 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.620816    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:00.703318 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.703283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:00.858369 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.858343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:00.879288 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.879221    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:47:00.879840 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.879818    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:47:00.959193 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.959168    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:00.959366 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.959206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:00.959366 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.959187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:00.959366 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:00.959302    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:00.959538 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:00.959386    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:00.959538 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:00.959472    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:00.999149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:00.999123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:01.206169 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.206090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:01.215593 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.215571    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:47:01.216060 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.216046    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bl2jh"
Jul 01 20:47:01.400779 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.400747    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:01.501327 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.501300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:01.601218 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.601193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:01.703617 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.703596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:01.805612 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.805583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:01.903333 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:01.903246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:02.219586 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.219376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm" event={"ID":"c3e54d2b-8773-4f7d-9591-4985550c948b","Type":"ContainerStarted","Data":"e31298009730f3114364edc2438b7b089d78256b934851c477295529b556c49e"}
Jul 01 20:47:02.222700 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.222682    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:47:02.223045 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.223023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"78c6247744fc539d70fa23a9cd8b2b1f110cb19418c7c7c5fa19468b7b491f65"}
Jul 01 20:47:02.223314 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.223283    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:47:02.223419 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.223352    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:47:02.223419 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.223390    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:47:02.223419 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.223393    2569 scope.go:117] "RemoveContainer" containerID="f843a4afe7d1bb0d45cce9b880f80accf70f1d4e1d1f27b21986b59923de4a4b"
Jul 01 20:47:02.225022 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.224985    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b95b10-440c-4b19-a5d3-5a98c20ddb49" containerID="725ef6c3e192ed4e252201c1cf15744739197070e4b5095f1a32ca1ea343aa47" exitCode=0
Jul 01 20:47:02.225105 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.225031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerDied","Data":"725ef6c3e192ed4e252201c1cf15744739197070e4b5095f1a32ca1ea343aa47"}
Jul 01 20:47:02.240126 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.240103    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:47:02.240308 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.240291    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:47:02.241416 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.241380    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrnpm" podStartSLOduration=4.226968483 podStartE2EDuration="27.241366982s" totalImagesPullingTime="23.014398499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:02.241205715 +0000 UTC m=+27.837092027" watchObservedRunningTime="2026-07-01 20:47:02.241366982 +0000 UTC m=+27.837253296"
Jul 01 20:47:02.608835 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.608800    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:02.805399 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.805323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:02.959474 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.959443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:02.959474 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.959460    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:02.959783 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:02.959448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:02.959783 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:02.959579    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:02.959783 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:02.959662    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:02.959783 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:02.959754    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:03.089849 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:03.089789    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:03.190345 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:03.190315    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:03.230508 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:03.230492    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:47:03.230842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:03.230803    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" event={"ID":"e3f536c1-9066-494e-be39-2a69df7f8e3d","Type":"ContainerStarted","Data":"3bb74abb1f91492279e605d9a2bc37eaf85a75379d470dd146de5269af9eb374"}
Jul 01 20:47:03.392114 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:03.392093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:03.997948 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:03.997920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:04.235128 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.235095    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b95b10-440c-4b19-a5d3-5a98c20ddb49" containerID="0d581cebd12cdf6befbf69e3c288843ce1a8e615eaf84ade6ea0bb6dd81223d9" exitCode=0
Jul 01 20:47:04.235517 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.235148    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerDied","Data":"0d581cebd12cdf6befbf69e3c288843ce1a8e615eaf84ade6ea0bb6dd81223d9"}
Jul 01 20:47:04.265707 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.265634    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq" podStartSLOduration=10.373837126 podStartE2EDuration="29.26562158s" totalImagesPullingTime="18.891784454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:03.283165437 +0000 UTC m=+28.879051751" watchObservedRunningTime="2026-07-01 20:47:04.26562158 +0000 UTC m=+29.861507871"
Jul 01 20:47:04.594720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.594642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:04.792674 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.792638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:04.962488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.962405    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:04.962488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.962431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:04.962488 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:04.962431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:04.962726 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:04.962523    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:04.962726 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:04.962651    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:04.962800 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:04.962740    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:05.029547 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:05.029522    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:05.392275 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:05.392252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:06.197219 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.197188    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:06.240807 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.240779    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b95b10-440c-4b19-a5d3-5a98c20ddb49" containerID="ee4b14b9a5cc499ea3c48907cc9aae6ae01ecd3de67e1f144dee857097e172ad" exitCode=0
Jul 01 20:47:06.240934 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.240820    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerDied","Data":"ee4b14b9a5cc499ea3c48907cc9aae6ae01ecd3de67e1f144dee857097e172ad"}
Jul 01 20:47:06.399912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.399884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:06.794588 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.794563    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:06.963026 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.962979    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:06.963209 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.963039    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:06.963209 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.963039    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:06.963209 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:06.963112    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:06.963209 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:06.963197    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:06.963433 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:06.963266    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:06.996288 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:06.996256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:07.209554 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:07.209457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:07.618202 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:07.618119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:08.040189 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:08.040085    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:08.590007 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:08.589966    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:08.590184 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:08.590044    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:08.590184 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.590107    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:47:08.590184 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.590124    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 20:47:08.590184 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.590167    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs podName:4bbe856a-007f-4829-add8-0d49859c4df7 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:40.590149551 +0000 UTC m=+66.186035857 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs") pod "network-metrics-daemon-xw4rh" (UID: "4bbe856a-007f-4829-add8-0d49859c4df7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 20:47:08.590184 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.590180    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret podName:8a5942d3-fea9-4fab-b135-20321b55466f nodeName:}" failed. No retries permitted until 2026-07-01 20:47:40.590174229 +0000 UTC m=+66.186060520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret") pod "global-pull-secret-syncer-bfr9n" (UID: "8a5942d3-fea9-4fab-b135-20321b55466f") : object "kube-system"/"original-pull-secret" not registered
Jul 01 20:47:08.690453 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:08.690422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:08.690811 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.690535    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 20:47:08.690811 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.690548    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 20:47:08.690811 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.690556    2569 projected.go:196] Error preparing data for projected volume kube-api-access-d4ph5 for pod openshift-network-diagnostics/network-check-target-6gj4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:47:08.690811 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.690597    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5 podName:66b431e3-36ab-4c51-b88d-1337ae631aab nodeName:}" failed. No retries permitted until 2026-07-01 20:47:40.690585666 +0000 UTC m=+66.286471958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4ph5" (UniqueName: "kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5") pod "network-check-target-6gj4t" (UID: "66b431e3-36ab-4c51-b88d-1337ae631aab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 20:47:08.959433 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:08.959320    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:08.959433 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:08.959359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:08.959433 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:08.959330    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:08.959665 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.959452    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:08.959665 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.959534    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:08.959665 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:08.959620    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:10.959704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:10.959647    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:10.959704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:10.959668    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:10.960065 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:10.959748    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:10.960065 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:10.959762    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:10.960065 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:10.959822    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:10.960065 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:10.959887    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:11.255501 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:11.255442    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b95b10-440c-4b19-a5d3-5a98c20ddb49" containerID="c0e55893dc0a4be1fcd9bd43403eb6a3b46b47d27b6a3bbdb222b7ed33057721" exitCode=0
Jul 01 20:47:11.255501 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:11.255484    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerDied","Data":"c0e55893dc0a4be1fcd9bd43403eb6a3b46b47d27b6a3bbdb222b7ed33057721"}
Jul 01 20:47:12.260244 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:12.260064    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6b95b10-440c-4b19-a5d3-5a98c20ddb49" containerID="1bef963bf73c6536f90d2b968b3be2edd050236eab129797920921c2a07ec572" exitCode=0
Jul 01 20:47:12.260244 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:12.260154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerDied","Data":"1bef963bf73c6536f90d2b968b3be2edd050236eab129797920921c2a07ec572"}
Jul 01 20:47:12.959571 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:12.959537    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:12.959571 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:12.959559    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:12.959793 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:12.959562    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:12.959793 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:12.959660    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:12.959793 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:12.959764    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:12.959946 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:12.959831    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:13.266113 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:13.266037    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrktm" event={"ID":"d6b95b10-440c-4b19-a5d3-5a98c20ddb49","Type":"ContainerStarted","Data":"783c1a560452d0658d16cdf107ebfd2612bd798f30a655d87afb375fa747bafe"}
Jul 01 20:47:13.290629 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:13.290585    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vrktm" podStartSLOduration=8.349860179 podStartE2EDuration="38.290573593s" totalImagesPullingTime="29.940713414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:13.29008334 +0000 UTC m=+38.885969654" watchObservedRunningTime="2026-07-01 20:47:13.290573593 +0000 UTC m=+38.886459906"
Jul 01 20:47:14.959843 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:14.959815    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:14.960203 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:14.959898    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:14.960203 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:14.959978    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:14.960203 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:14.960105    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:14.960203 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:14.960153    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:14.960335 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:14.960234    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:16.715815 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:16.715778    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:16.818234 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:16.818207    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:16.959711 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:16.959686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:16.959852 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:16.959686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:16.959852 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:16.959785    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:16.959937 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:16.959687    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:16.959937 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:16.959873    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:16.960024 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:16.959941    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:18.959735 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:18.959704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:18.959735 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:18.959722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:18.959735 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:18.959720    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:18.960216 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:18.959801    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:18.960216 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:18.959898    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:18.960216 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:18.959944    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:20.217907 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.217866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:20.318704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.318678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:20.422472 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.422446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:20.718307 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.718270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:20.836341 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.836306    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:20.930356 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.930328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:20.959086 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.959065    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:20.959225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.959073    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:20.959225 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:20.959156    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:20.959304 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:20.959247    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:20.959337 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:20.959305    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:20.959398 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:20.959378    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:21.044887 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:21.044792    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:21.182034 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:21.181988    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:21.554797 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:21.554771    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:21.629533 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:21.629498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:22.081255 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:22.081226    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xw4rh"]
Jul 01 20:47:22.081450 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:22.081321    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:22.081450 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:22.081416    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:22.085274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:22.085010    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6gj4t"]
Jul 01 20:47:22.085274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:22.085114    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:22.085274 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:22.085215    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:22.085759 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:22.085738    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfr9n"]
Jul 01 20:47:22.085834 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:22.085821    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:22.085932 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:22.085909    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:23.959045 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:23.959017    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:23.959045 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:23.959037    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:23.959733 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:23.959106    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:23.959733 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:23.959115    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:23.959733 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:23.959181    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:23.959733 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:23.959240    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:24.177168 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:24.177133    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:24.253984 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:24.253900    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:25.958975 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:25.958760    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:25.959392 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:25.958817    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:25.959392 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:25.959079    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfr9n" podUID="8a5942d3-fea9-4fab-b135-20321b55466f"
Jul 01 20:47:25.959392 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:25.958823    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:25.959392 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:25.959138    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gj4t" podUID="66b431e3-36ab-4c51-b88d-1337ae631aab"
Jul 01 20:47:25.959392 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:25.959213    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xw4rh" podUID="4bbe856a-007f-4829-add8-0d49859c4df7"
Jul 01 20:47:26.722756 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.722732    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeReady"
Jul 01 20:47:26.722908 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.722841    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 01 20:47:26.770717 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.770671    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-brdtq"]
Jul 01 20:47:26.792029 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.791988    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-45r8m"]
Jul 01 20:47:26.792140 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.792099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:26.796340 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.796319    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 01 20:47:26.796500 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.796325    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 01 20:47:26.796500 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.796398    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7ck8j\""
Jul 01 20:47:26.796640 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.796503    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 01 20:47:26.815926 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.815904    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brdtq"]
Jul 01 20:47:26.816030 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.815933    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45r8m"]
Jul 01 20:47:26.816030 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.815954    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-snkfr"]
Jul 01 20:47:26.816108 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.816033    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:26.818946 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.818929    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 01 20:47:26.819057 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.818946    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 01 20:47:26.819207 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.819191    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9fsnr\""
Jul 01 20:47:26.819365 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.819346    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 01 20:47:26.820250 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.820236    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 01 20:47:26.821499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.821422    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4nnv\" (UniqueName: \"kubernetes.io/projected/431cee6f-7c0a-4538-a443-824210c58055-kube-api-access-h4nnv\") pod \"ingress-canary-brdtq\" (UID: \"431cee6f-7c0a-4538-a443-824210c58055\") " pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:26.821499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.821477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/431cee6f-7c0a-4538-a443-824210c58055-cert\") pod \"ingress-canary-brdtq\" (UID: \"431cee6f-7c0a-4538-a443-824210c58055\") " pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:26.836228 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.836211    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-snkfr"]
Jul 01 20:47:26.836303 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.836287    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:26.841205 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.841189    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 01 20:47:26.841443 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.841418    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 01 20:47:26.841443 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.841418    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f5twz\""
Jul 01 20:47:26.922241 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56a0c051-e108-48d9-8ac0-3aeef2cead6c-crio-socket\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:26.922335 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922247    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56a0c051-e108-48d9-8ac0-3aeef2cead6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:26.922335 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922265    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baef25eb-1d31-4b63-832a-417ae034b11e-metrics-tls\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:26.922335 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/431cee6f-7c0a-4538-a443-824210c58055-cert\") pod \"ingress-canary-brdtq\" (UID: \"431cee6f-7c0a-4538-a443-824210c58055\") " pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:26.922466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922359    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-875gp\" (UniqueName: \"kubernetes.io/projected/56a0c051-e108-48d9-8ac0-3aeef2cead6c-kube-api-access-875gp\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:26.922466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/baef25eb-1d31-4b63-832a-417ae034b11e-config-volume\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:26.922466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922412    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baef25eb-1d31-4b63-832a-417ae034b11e-tmp-dir\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:26.922466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4427w\" (UniqueName: \"kubernetes.io/projected/baef25eb-1d31-4b63-832a-417ae034b11e-kube-api-access-4427w\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:26.922466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922457    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4nnv\" (UniqueName: \"kubernetes.io/projected/431cee6f-7c0a-4538-a443-824210c58055-kube-api-access-h4nnv\") pod \"ingress-canary-brdtq\" (UID: \"431cee6f-7c0a-4538-a443-824210c58055\") " pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:26.922673 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922472    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a0c051-e108-48d9-8ac0-3aeef2cead6c-data-volume\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:26.922673 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.922502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56a0c051-e108-48d9-8ac0-3aeef2cead6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:26.926234 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.926211    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/431cee6f-7c0a-4538-a443-824210c58055-cert\") pod \"ingress-canary-brdtq\" (UID: \"431cee6f-7c0a-4538-a443-824210c58055\") " pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:26.930907 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.930888    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4nnv\" (UniqueName: \"kubernetes.io/projected/431cee6f-7c0a-4538-a443-824210c58055-kube-api-access-h4nnv\") pod \"ingress-canary-brdtq\" (UID: \"431cee6f-7c0a-4538-a443-824210c58055\") " pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:26.941821 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:26.941793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:27.006449 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.006394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:27.023559 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023539    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4427w\" (UniqueName: \"kubernetes.io/projected/baef25eb-1d31-4b63-832a-417ae034b11e-kube-api-access-4427w\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.023637 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a0c051-e108-48d9-8ac0-3aeef2cead6c-data-volume\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.023637 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56a0c051-e108-48d9-8ac0-3aeef2cead6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.023637 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023619    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56a0c051-e108-48d9-8ac0-3aeef2cead6c-crio-socket\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.023767 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023645    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56a0c051-e108-48d9-8ac0-3aeef2cead6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.023767 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023661    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baef25eb-1d31-4b63-832a-417ae034b11e-metrics-tls\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.023767 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-875gp\" (UniqueName: \"kubernetes.io/projected/56a0c051-e108-48d9-8ac0-3aeef2cead6c-kube-api-access-875gp\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.023767 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023739    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56a0c051-e108-48d9-8ac0-3aeef2cead6c-crio-socket\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.023959 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/baef25eb-1d31-4b63-832a-417ae034b11e-config-volume\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.023959 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023894    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baef25eb-1d31-4b63-832a-417ae034b11e-tmp-dir\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.024071 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.023986    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a0c051-e108-48d9-8ac0-3aeef2cead6c-data-volume\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.024217 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.024198    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baef25eb-1d31-4b63-832a-417ae034b11e-tmp-dir\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.024311 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.024295    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56a0c051-e108-48d9-8ac0-3aeef2cead6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.024431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.024414    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/baef25eb-1d31-4b63-832a-417ae034b11e-config-volume\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.025763 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.025742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baef25eb-1d31-4b63-832a-417ae034b11e-metrics-tls\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.026064 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.026045    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56a0c051-e108-48d9-8ac0-3aeef2cead6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.035880 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.035854    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-875gp\" (UniqueName: \"kubernetes.io/projected/56a0c051-e108-48d9-8ac0-3aeef2cead6c-kube-api-access-875gp\") pod \"insights-runtime-extractor-45r8m\" (UID: \"56a0c051-e108-48d9-8ac0-3aeef2cead6c\") " pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.037295 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.037275    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4427w\" (UniqueName: \"kubernetes.io/projected/baef25eb-1d31-4b63-832a-417ae034b11e-kube-api-access-4427w\") pod \"dns-default-snkfr\" (UID: \"baef25eb-1d31-4b63-832a-417ae034b11e\") " pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.102794 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.102774    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brdtq"
Jul 01 20:47:27.124081 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.124065    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45r8m"
Jul 01 20:47:27.144527 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.144501    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:27.339446 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.339415    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brdtq"]
Jul 01 20:47:27.342052 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.342029    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-snkfr"]
Jul 01 20:47:27.343562 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:27.343523    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431cee6f_7c0a_4538_a443_824210c58055.slice/crio-de1baed046b36c2b00d3c032e2f7acb44b29aaa2a9d224e167fd7f2976aca67e WatchSource:0}: Error finding container de1baed046b36c2b00d3c032e2f7acb44b29aaa2a9d224e167fd7f2976aca67e: Status 404 returned error can't find the container with id de1baed046b36c2b00d3c032e2f7acb44b29aaa2a9d224e167fd7f2976aca67e
Jul 01 20:47:27.345980 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.345694    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45r8m"]
Jul 01 20:47:27.346467 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:27.346436    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaef25eb_1d31_4b63_832a_417ae034b11e.slice/crio-37359ba703907fcbfa9905022b8aa4450801ce7710473b8376ae038c7013cf1c WatchSource:0}: Error finding container 37359ba703907fcbfa9905022b8aa4450801ce7710473b8376ae038c7013cf1c: Status 404 returned error can't find the container with id 37359ba703907fcbfa9905022b8aa4450801ce7710473b8376ae038c7013cf1c
Jul 01 20:47:27.350113 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:27.350091    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a0c051_e108_48d9_8ac0_3aeef2cead6c.slice/crio-ce58042fd7e48c4c86f5e8c290f71aacc50539b6dd085332fe69f48ab7232998 WatchSource:0}: Error finding container ce58042fd7e48c4c86f5e8c290f71aacc50539b6dd085332fe69f48ab7232998: Status 404 returned error can't find the container with id ce58042fd7e48c4c86f5e8c290f71aacc50539b6dd085332fe69f48ab7232998
Jul 01 20:47:27.959799 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.959758    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:27.961210 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.961149    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:27.961210 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.961161    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:27.965227 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.965206    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 20:47:27.965541 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.965519    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 20:47:27.965784 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.965760    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 20:47:27.966329 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.966016    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v6s46\""
Jul 01 20:47:27.966329 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.966062    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 20:47:27.966329 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:27.966204    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4g6n6\""
Jul 01 20:47:28.302732 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.302580    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r8m" event={"ID":"56a0c051-e108-48d9-8ac0-3aeef2cead6c","Type":"ContainerStarted","Data":"ce58042fd7e48c4c86f5e8c290f71aacc50539b6dd085332fe69f48ab7232998"}
Jul 01 20:47:28.306983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.306869    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brdtq" event={"ID":"431cee6f-7c0a-4538-a443-824210c58055","Type":"ContainerStarted","Data":"de1baed046b36c2b00d3c032e2f7acb44b29aaa2a9d224e167fd7f2976aca67e"}
Jul 01 20:47:28.308955 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.308831    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-snkfr" event={"ID":"baef25eb-1d31-4b63-832a-417ae034b11e","Type":"ContainerStarted","Data":"37359ba703907fcbfa9905022b8aa4450801ce7710473b8376ae038c7013cf1c"}
Jul 01 20:47:28.455326 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.455289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:28.488045 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.488015    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"]
Jul 01 20:47:28.499801 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.499780    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.500510 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.500449    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"]
Jul 01 20:47:28.502969 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.502327    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 01 20:47:28.502969 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.502764    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 01 20:47:28.504039 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.503234    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 01 20:47:28.504039 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.503451    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 01 20:47:28.504039 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.503642    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 01 20:47:28.504039 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.503936    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zwlk8\""
Jul 01 20:47:28.523813 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.523098    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:28.535075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.534811    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.535075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.534862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.535075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.534913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z8rt\" (UniqueName: \"kubernetes.io/projected/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-kube-api-access-6z8rt\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.535075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.534959    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.635811 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.635762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.636009 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.635835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.636009 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.635892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z8rt\" (UniqueName: \"kubernetes.io/projected/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-kube-api-access-6z8rt\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.636009 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.635945    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.637029 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:28.636298    2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 01 20:47:28.637029 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:28.636376    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-tls podName:01c8a539-5b78-49f5-b360-f4a5ab3ff48a nodeName:}" failed. No retries permitted until 2026-07-01 20:47:29.136356301 +0000 UTC m=+54.732242594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-5rmm2" (UID: "01c8a539-5b78-49f5-b360-f4a5ab3ff48a") : secret "prometheus-operator-tls" not found
Jul 01 20:47:28.637516 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.637430    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.648027 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.647961    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.649212 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.649138    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z8rt\" (UniqueName: \"kubernetes.io/projected/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-kube-api-access-6z8rt\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:28.849555 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:28.849523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:29.140755 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:29.140658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:29.146412 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:29.146359    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/01c8a539-5b78-49f5-b360-f4a5ab3ff48a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-5rmm2\" (UID: \"01c8a539-5b78-49f5-b360-f4a5ab3ff48a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:29.413855 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:29.413749    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"
Jul 01 20:47:30.250212 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:30.250177    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:30.322748 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:30.322716    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:30.977296 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:30.977261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:31.207457 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:31.207425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:33.047471 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.047449    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-5rmm2"]
Jul 01 20:47:33.051341 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:33.051318    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c8a539_5b78_49f5_b360_f4a5ab3ff48a.slice/crio-de012ea2bff76884bd93008e0074366890fe4ad4ca13afc53593772e1cf4490b WatchSource:0}: Error finding container de012ea2bff76884bd93008e0074366890fe4ad4ca13afc53593772e1cf4490b: Status 404 returned error can't find the container with id de012ea2bff76884bd93008e0074366890fe4ad4ca13afc53593772e1cf4490b
Jul 01 20:47:33.327381 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.327351    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-snkfr" event={"ID":"baef25eb-1d31-4b63-832a-417ae034b11e","Type":"ContainerStarted","Data":"1864713a5a6bde89cb2d1975113975f2d901d9597a8244a8d4a72f687b431408"}
Jul 01 20:47:33.327519 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.327414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-snkfr" event={"ID":"baef25eb-1d31-4b63-832a-417ae034b11e","Type":"ContainerStarted","Data":"504a26a737bc981d7d503b6145e3fe1190124486af4cf7bd123055bcc2f15d1a"}
Jul 01 20:47:33.327519 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.327493    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:33.329098 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.329074    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r8m" event={"ID":"56a0c051-e108-48d9-8ac0-3aeef2cead6c","Type":"ContainerStarted","Data":"f1133e06a3c37db6ab7555a93257b9a72074a1cba7f07b7154d3024ac88edb65"}
Jul 01 20:47:33.330903 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.330850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brdtq" event={"ID":"431cee6f-7c0a-4538-a443-824210c58055","Type":"ContainerStarted","Data":"d268d86e7c912308a879395f7ef4bab68df1b604a4c58db7f7adcce19de4e526"}
Jul 01 20:47:33.332062 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.332043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2" event={"ID":"01c8a539-5b78-49f5-b360-f4a5ab3ff48a","Type":"ContainerStarted","Data":"de012ea2bff76884bd93008e0074366890fe4ad4ca13afc53593772e1cf4490b"}
Jul 01 20:47:33.360898 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.360852    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-snkfr" podStartSLOduration=1.793345348 podStartE2EDuration="7.3608407s" totalImagesPullingTime="5.567495352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:33.359320278 +0000 UTC m=+58.955206590" watchObservedRunningTime="2026-07-01 20:47:33.3608407 +0000 UTC m=+58.956726991"
Jul 01 20:47:33.402816 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:33.402769    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-brdtq" podStartSLOduration=1.824162126 podStartE2EDuration="7.402755541s" totalImagesPullingTime="5.578593415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:33.402496638 +0000 UTC m=+58.998382942" watchObservedRunningTime="2026-07-01 20:47:33.402755541 +0000 UTC m=+58.998641855"
Jul 01 20:47:34.246891 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:34.246827    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2zrq"
Jul 01 20:47:34.338956 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:34.338925    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r8m" event={"ID":"56a0c051-e108-48d9-8ac0-3aeef2cead6c","Type":"ContainerStarted","Data":"fab9bf2d355fcc4205d3756d6d0cb39b7150bbe19865c06bce73f8b01cb41f0a"}
Jul 01 20:47:34.415692 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:34.415662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:34.499287 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:34.499215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:35.267262 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:35.267176    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:35.345128 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:35.345097    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2" event={"ID":"01c8a539-5b78-49f5-b360-f4a5ab3ff48a","Type":"ContainerStarted","Data":"b28b3a29524114d3828d4196b492fd12e3967283a06113822a691eee5bbcb4d8"}
Jul 01 20:47:35.345289 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:35.345159    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2" event={"ID":"01c8a539-5b78-49f5-b360-f4a5ab3ff48a","Type":"ContainerStarted","Data":"974dc5f58f5427833194340ed5fb384543d36a0cc25be6d464cb57803748c0ff"}
Jul 01 20:47:35.365511 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:35.365455    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-5rmm2" podStartSLOduration=5.4838573010000005 podStartE2EDuration="7.365435015s" totalImagesPullingTime="1.881577714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:35.363344385 +0000 UTC m=+60.959230699" watchObservedRunningTime="2026-07-01 20:47:35.365435015 +0000 UTC m=+60.961321331"
Jul 01 20:47:36.637266 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.637233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:36.868360 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.868331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:36.878326 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.878300    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"]
Jul 01 20:47:36.880296 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.880281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:36.882825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.882800    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 01 20:47:36.882934 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.882828    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 01 20:47:36.883146 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.883129    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lclhn\""
Jul 01 20:47:36.901625 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.901584    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"]
Jul 01 20:47:36.913775 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.913754    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-wglvf"]
Jul 01 20:47:36.915593 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.915578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:36.918903 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.918886    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-22rcx"]
Jul 01 20:47:36.919523 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.919504    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 01 20:47:36.919627 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.919536    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fg79g\""
Jul 01 20:47:36.919627 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.919514    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 01 20:47:36.920616 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.920598    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 01 20:47:36.921004 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.920980    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:36.924526 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.924510    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 01 20:47:36.924625 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.924595    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 01 20:47:36.924840 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.924822    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dh9nf\""
Jul 01 20:47:36.925082 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.925068    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 01 20:47:36.934176 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.934155    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-wglvf"]
Jul 01 20:47:36.980362 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:36.980340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:37.004739 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-accelerators-collector-config\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.004839 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-textfile\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.004839 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12c84c6e-fa36-4251-83d6-e4321e010852-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.004839 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-tls\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.004839 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004802    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.005087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.005087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004929    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.005087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.004971    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de6f364-3d81-4971-8b7e-b94e91780724-metrics-client-ca\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.005087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005025    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5v6v\" (UniqueName: \"kubernetes.io/projected/7e1bd593-dfdf-4659-9782-07241377de11-kube-api-access-s5v6v\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.005087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6ffk\" (UniqueName: \"kubernetes.io/projected/7de6f364-3d81-4971-8b7e-b94e91780724-kube-api-access-s6ffk\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.005087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005082    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-root\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6c4q\" (UniqueName: \"kubernetes.io/projected/12c84c6e-fa36-4251-83d6-e4321e010852-kube-api-access-v6c4q\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005194    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-sys\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-wtmp\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7de6f364-3d81-4971-8b7e-b94e91780724-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.005373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.005311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e1bd593-dfdf-4659-9782-07241377de11-metrics-client-ca\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.075727 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.075709    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:37.105757 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105730    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.105842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de6f364-3d81-4971-8b7e-b94e91780724-metrics-client-ca\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.105842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105788    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5v6v\" (UniqueName: \"kubernetes.io/projected/7e1bd593-dfdf-4659-9782-07241377de11-kube-api-access-s5v6v\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.105842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105802    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ffk\" (UniqueName: \"kubernetes.io/projected/7de6f364-3d81-4971-8b7e-b94e91780724-kube-api-access-s6ffk\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.105842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-root\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105865    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-root\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105935    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.106075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.105976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6c4q\" (UniqueName: \"kubernetes.io/projected/12c84c6e-fa36-4251-83d6-e4321e010852-kube-api-access-v6c4q\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.106075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.106274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-sys\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-wtmp\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7de6f364-3d81-4971-8b7e-b94e91780724-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.106274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106241    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-sys\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106253    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e1bd593-dfdf-4659-9782-07241377de11-metrics-client-ca\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106318    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-wtmp\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106342    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-accelerators-collector-config\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106371    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-textfile\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12c84c6e-fa36-4251-83d6-e4321e010852-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-tls\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.106539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106498    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106926 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106601    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7de6f364-3d81-4971-8b7e-b94e91780724-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.106926 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106610    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de6f364-3d81-4971-8b7e-b94e91780724-metrics-client-ca\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.106926 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106887    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-textfile\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.106926 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.107176 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.106925    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e1bd593-dfdf-4659-9782-07241377de11-metrics-client-ca\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.107176 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:37.106978    2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 01 20:47:37.107176 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:37.107045    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-tls podName:12c84c6e-fa36-4251-83d6-e4321e010852 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:37.607031843 +0000 UTC m=+63.202918135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-n6jk2" (UID: "12c84c6e-fa36-4251-83d6-e4321e010852") : secret "openshift-state-metrics-tls" not found
Jul 01 20:47:37.107454 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.107427    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-accelerators-collector-config\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.107614 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.107596    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12c84c6e-fa36-4251-83d6-e4321e010852-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.109244 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.109217    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-tls\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.109323 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.109285    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.109362 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.109287    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.109362 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.109318    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e1bd593-dfdf-4659-9782-07241377de11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.109596 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.109581    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7de6f364-3d81-4971-8b7e-b94e91780724-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.113505 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.113477    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5v6v\" (UniqueName: \"kubernetes.io/projected/7e1bd593-dfdf-4659-9782-07241377de11-kube-api-access-s5v6v\") pod \"node-exporter-22rcx\" (UID: \"7e1bd593-dfdf-4659-9782-07241377de11\") " pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.113613 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.113516    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6ffk\" (UniqueName: \"kubernetes.io/projected/7de6f364-3d81-4971-8b7e-b94e91780724-kube-api-access-s6ffk\") pod \"kube-state-metrics-845b954455-wglvf\" (UID: \"7de6f364-3d81-4971-8b7e-b94e91780724\") " pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.113671 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.113654    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6c4q\" (UniqueName: \"kubernetes.io/projected/12c84c6e-fa36-4251-83d6-e4321e010852-kube-api-access-v6c4q\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.224849 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.224784    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf"
Jul 01 20:47:37.231246 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.231166    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-22rcx"
Jul 01 20:47:37.242837 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.242815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:37.243367 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:37.243335    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1bd593_dfdf_4659_9782_07241377de11.slice/crio-2eb1f883dc8f4d2ff3bc3f1d1e5063f544291b7779cb8b82b4eff3af3631b140 WatchSource:0}: Error finding container 2eb1f883dc8f4d2ff3bc3f1d1e5063f544291b7779cb8b82b4eff3af3631b140: Status 404 returned error can't find the container with id 2eb1f883dc8f4d2ff3bc3f1d1e5063f544291b7779cb8b82b4eff3af3631b140
Jul 01 20:47:37.342888 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.342849    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:37.352678 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.352649    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22rcx" event={"ID":"7e1bd593-dfdf-4659-9782-07241377de11","Type":"ContainerStarted","Data":"2eb1f883dc8f4d2ff3bc3f1d1e5063f544291b7779cb8b82b4eff3af3631b140"}
Jul 01 20:47:37.355408 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.355383    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-wglvf"]
Jul 01 20:47:37.356085 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.355947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r8m" event={"ID":"56a0c051-e108-48d9-8ac0-3aeef2cead6c","Type":"ContainerStarted","Data":"dbbda93488592bc4fbc92c6ac6ea70a7c0e50726bc7dd5f21dc7fefb34c81911"}
Jul 01 20:47:37.358318 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:37.358287    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de6f364_3d81_4971_8b7e_b94e91780724.slice/crio-efa82aba64a38e9c39f31d1a1de666ee669f9d4fc3b40a94251c4670f6b92858 WatchSource:0}: Error finding container efa82aba64a38e9c39f31d1a1de666ee669f9d4fc3b40a94251c4670f6b92858: Status 404 returned error can't find the container with id efa82aba64a38e9c39f31d1a1de666ee669f9d4fc3b40a94251c4670f6b92858
Jul 01 20:47:37.374940 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.374903    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-45r8m" podStartSLOduration=2.390126057 podStartE2EDuration="11.374888353s" totalImagesPullingTime="8.984762296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:47:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:37.37427977 +0000 UTC m=+62.970166095" watchObservedRunningTime="2026-07-01 20:47:37.374888353 +0000 UTC m=+62.970774666"
Jul 01 20:47:37.452295 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.452268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:37.609230 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.609197    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.611417 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.611399    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c84c6e-fa36-4251-83d6-e4321e010852-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-n6jk2\" (UID: \"12c84c6e-fa36-4251-83d6-e4321e010852\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.734123 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.734099    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:37.788426 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.788407    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"
Jul 01 20:47:37.878485 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.878419    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:37.936192 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.935626    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2"]
Jul 01 20:47:37.939950 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:37.939916    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c84c6e_fa36_4251_83d6_e4321e010852.slice/crio-e54b04d01111f0bf667e86e7929c789a3ae495ebda560f6b4408b3edb733fd31 WatchSource:0}: Error finding container e54b04d01111f0bf667e86e7929c789a3ae495ebda560f6b4408b3edb733fd31: Status 404 returned error can't find the container with id e54b04d01111f0bf667e86e7929c789a3ae495ebda560f6b4408b3edb733fd31
Jul 01 20:47:37.972787 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:37.972757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:38.360889 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:38.360865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2" event={"ID":"12c84c6e-fa36-4251-83d6-e4321e010852","Type":"ContainerStarted","Data":"ffd161f6aece1d615f57a4cee2727ca50dbf17c6957ff8d51af2ed24dea4315d"}
Jul 01 20:47:38.361018 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:38.360918    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2" event={"ID":"12c84c6e-fa36-4251-83d6-e4321e010852","Type":"ContainerStarted","Data":"0a1bf45e46c7724c2651576f3599811c2be7dcb5b2b827a6f4f4943b8564f8de"}
Jul 01 20:47:38.361018 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:38.360945    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2" event={"ID":"12c84c6e-fa36-4251-83d6-e4321e010852","Type":"ContainerStarted","Data":"e54b04d01111f0bf667e86e7929c789a3ae495ebda560f6b4408b3edb733fd31"}
Jul 01 20:47:38.362130 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:38.362110    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf" event={"ID":"7de6f364-3d81-4971-8b7e-b94e91780724","Type":"ContainerStarted","Data":"efa82aba64a38e9c39f31d1a1de666ee669f9d4fc3b40a94251c4670f6b92858"}
Jul 01 20:47:38.582295 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:38.582220    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:39.366104 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.366079    2569 generic.go:356] "Generic (PLEG): container finished" podID="7e1bd593-dfdf-4659-9782-07241377de11" containerID="2dd84ca973060488f3a5250bede53032b19f00aadefcd5d815fbc28f8a63cdaf" exitCode=0
Jul 01 20:47:39.366424 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.366164    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22rcx" event={"ID":"7e1bd593-dfdf-4659-9782-07241377de11","Type":"ContainerDied","Data":"2dd84ca973060488f3a5250bede53032b19f00aadefcd5d815fbc28f8a63cdaf"}
Jul 01 20:47:39.836683 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.836646    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:39.871064 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.871040    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"]
Jul 01 20:47:39.873362 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.873339    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.875805 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.875783    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qtwkf\""
Jul 01 20:47:39.875913 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.875853    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 01 20:47:39.876207 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.876183    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 01 20:47:39.876292 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.876225    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 01 20:47:39.876659 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.876639    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4lau7jqobalmg\""
Jul 01 20:47:39.876759 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.876647    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 01 20:47:39.876759 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.876686    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 01 20:47:39.890967 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.890942    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"]
Jul 01 20:47:39.900449 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.900432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:39.929242 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929220    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrwwh\" (UniqueName: \"kubernetes.io/projected/66b389f2-bea2-4f6f-8ff1-782354b3a79e-kube-api-access-nrwwh\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.929336 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.929336 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b389f2-bea2-4f6f-8ff1-782354b3a79e-metrics-client-ca\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.929336 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929312    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.929462 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929355    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.929462 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.929462 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-grpc-tls\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.929462 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.929423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-tls\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:39.998679 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:39.998653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:40.030603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030581    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.030675 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030615    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.030675 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-grpc-tls\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.030790 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030680    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-tls\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.030790 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrwwh\" (UniqueName: \"kubernetes.io/projected/66b389f2-bea2-4f6f-8ff1-782354b3a79e-kube-api-access-nrwwh\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.030790 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.030790 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b389f2-bea2-4f6f-8ff1-782354b3a79e-metrics-client-ca\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.030938 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.030846    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.031603 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.031578    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b389f2-bea2-4f6f-8ff1-782354b3a79e-metrics-client-ca\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.033593 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.033568    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.033694 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.033675    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.033742 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.033730    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-grpc-tls\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.033854 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.033829    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.033894 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.033878    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.033894 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.033886    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66b389f2-bea2-4f6f-8ff1-782354b3a79e-secret-thanos-querier-tls\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.038960 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.038939    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrwwh\" (UniqueName: \"kubernetes.io/projected/66b389f2-bea2-4f6f-8ff1-782354b3a79e-kube-api-access-nrwwh\") pod \"thanos-querier-5d97ff7b86-c82n6\" (UID: \"66b389f2-bea2-4f6f-8ff1-782354b3a79e\") " pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.183225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.183142    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:40.266452 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.266406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:40.315139 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.315117    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"]
Jul 01 20:47:40.317232 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:40.317213    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b389f2_bea2_4f6f_8ff1_782354b3a79e.slice/crio-f631262162783888da0d5789a1af501950eef37d5d4187eb049af8347d22b684 WatchSource:0}: Error finding container f631262162783888da0d5789a1af501950eef37d5d4187eb049af8347d22b684: Status 404 returned error can't find the container with id f631262162783888da0d5789a1af501950eef37d5d4187eb049af8347d22b684
Jul 01 20:47:40.367404 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.367371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:40.370621 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.370599    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" event={"ID":"66b389f2-bea2-4f6f-8ff1-782354b3a79e","Type":"ContainerStarted","Data":"f631262162783888da0d5789a1af501950eef37d5d4187eb049af8347d22b684"}
Jul 01 20:47:40.372655 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.372634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22rcx" event={"ID":"7e1bd593-dfdf-4659-9782-07241377de11","Type":"ContainerStarted","Data":"6d1e6545a7522ea2b789e42cc6f12746e96ff2f97be81aaf800ff1018c4a8214"}
Jul 01 20:47:40.372745 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.372674    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-22rcx" event={"ID":"7e1bd593-dfdf-4659-9782-07241377de11","Type":"ContainerStarted","Data":"e8ad0107575398f3db519af5385855e05366bb70913aedad2f22210aa6fca05e"}
Jul 01 20:47:40.374546 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.374528    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2" event={"ID":"12c84c6e-fa36-4251-83d6-e4321e010852","Type":"ContainerStarted","Data":"06eeaf7305fefad0b142aaaaef30559dd8ea6b9d95f441f4e1b4162baa2bbb03"}
Jul 01 20:47:40.376388 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.376366    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf" event={"ID":"7de6f364-3d81-4971-8b7e-b94e91780724","Type":"ContainerStarted","Data":"d92c228c0e95545dc32d2c7ac027b985bdc9cbe1c9ae11c54d073f61f5935a9d"}
Jul 01 20:47:40.376480 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.376415    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf" event={"ID":"7de6f364-3d81-4971-8b7e-b94e91780724","Type":"ContainerStarted","Data":"4fce0d98d7ddc0c4e29367216512fdbb9dba566431e65f15c10ff676a814e9fc"}
Jul 01 20:47:40.376480 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.376438    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf" event={"ID":"7de6f364-3d81-4971-8b7e-b94e91780724","Type":"ContainerStarted","Data":"4ec7b29f49a02ca8a28a38d7916c9e1413e1b66a3014ce9fbd04dc205900e8ce"}
Jul 01 20:47:40.397922 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.397878    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-22rcx" podStartSLOduration=3.273994003 podStartE2EDuration="4.397862174s" totalImagesPullingTime="1.062125827s" totalInitContainerRuntime="61.742344ms" isStatefulPod=true podCreationTimestamp="2026-07-01 20:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:40.397286854 +0000 UTC m=+65.993173168" watchObservedRunningTime="2026-07-01 20:47:40.397862174 +0000 UTC m=+65.993748492"
Jul 01 20:47:40.417944 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.417908    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-n6jk2" podStartSLOduration=3.115400192 podStartE2EDuration="4.417895871s" totalImagesPullingTime="1.302495679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:40.417127418 +0000 UTC m=+66.013013730" watchObservedRunningTime="2026-07-01 20:47:40.417895871 +0000 UTC m=+66.013782197"
Jul 01 20:47:40.437256 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.437195    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-wglvf" podStartSLOduration=2.435917518 podStartE2EDuration="4.437182784s" totalImagesPullingTime="2.001265266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:40.436188222 +0000 UTC m=+66.032074534" watchObservedRunningTime="2026-07-01 20:47:40.437182784 +0000 UTC m=+66.033069097"
Jul 01 20:47:40.636923 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.636901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:40.637059 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.636950    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:40.639244 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.639226    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 20:47:40.639304 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.639264    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 20:47:40.650269 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.650242    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbe856a-007f-4829-add8-0d49859c4df7-metrics-certs\") pod \"network-metrics-daemon-xw4rh\" (UID: \"4bbe856a-007f-4829-add8-0d49859c4df7\") " pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:40.650354 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.650298    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a5942d3-fea9-4fab-b135-20321b55466f-original-pull-secret\") pod \"global-pull-secret-syncer-bfr9n\" (UID: \"8a5942d3-fea9-4fab-b135-20321b55466f\") " pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:40.737889 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.737840    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:40.740450 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.740434    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 20:47:40.750867 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.750849    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 20:47:40.761278 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.761253    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4ph5\" (UniqueName: \"kubernetes.io/projected/66b431e3-36ab-4c51-b88d-1337ae631aab-kube-api-access-d4ph5\") pod \"network-check-target-6gj4t\" (UID: \"66b431e3-36ab-4c51-b88d-1337ae631aab\") " pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:40.877092 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.877060    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfr9n"
Jul 01 20:47:40.888679 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.888656    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4g6n6\""
Jul 01 20:47:40.895698 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.895674    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v6s46\""
Jul 01 20:47:40.896733 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.896714    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:40.903828 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:40.903808    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xw4rh"
Jul 01 20:47:41.024322 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.024292    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfr9n"]
Jul 01 20:47:41.030850 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:41.030810    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5942d3_fea9_4fab_b135_20321b55466f.slice/crio-54eb00dbbde1cc78e236f8a125e0941bc5e0c056c8d0f37d327635cfc4f5fbba WatchSource:0}: Error finding container 54eb00dbbde1cc78e236f8a125e0941bc5e0c056c8d0f37d327635cfc4f5fbba: Status 404 returned error can't find the container with id 54eb00dbbde1cc78e236f8a125e0941bc5e0c056c8d0f37d327635cfc4f5fbba
Jul 01 20:47:41.251583 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.251558    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xw4rh"]
Jul 01 20:47:41.254488 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:41.254458    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbe856a_007f_4829_add8_0d49859c4df7.slice/crio-9cf98acc0f6ee8d4ba0cae77830853ce6bf99576fa5fd92e9a28d43c0db1a269 WatchSource:0}: Error finding container 9cf98acc0f6ee8d4ba0cae77830853ce6bf99576fa5fd92e9a28d43c0db1a269: Status 404 returned error can't find the container with id 9cf98acc0f6ee8d4ba0cae77830853ce6bf99576fa5fd92e9a28d43c0db1a269
Jul 01 20:47:41.254595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.254558    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6gj4t"]
Jul 01 20:47:41.257549 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:41.257519    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b431e3_36ab_4c51_b88d_1337ae631aab.slice/crio-4e125dbc7877919e86e4365f7a454faf57e695007f7b27ab11172a5dfa70b4bb WatchSource:0}: Error finding container 4e125dbc7877919e86e4365f7a454faf57e695007f7b27ab11172a5dfa70b4bb: Status 404 returned error can't find the container with id 4e125dbc7877919e86e4365f7a454faf57e695007f7b27ab11172a5dfa70b4bb
Jul 01 20:47:41.322889 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.321667    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"]
Jul 01 20:47:41.325015 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.324977    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.327853 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.327830    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 01 20:47:41.327853 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.327841    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gd9lz\""
Jul 01 20:47:41.328486 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.328457    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2qrnavgoncspv\""
Jul 01 20:47:41.328581 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.328546    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 01 20:47:41.328657 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.328576    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 01 20:47:41.328657 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.328655    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 01 20:47:41.340841 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.340807    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"]
Jul 01 20:47:41.382861 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.382807    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xw4rh" event={"ID":"4bbe856a-007f-4829-add8-0d49859c4df7","Type":"ContainerStarted","Data":"9cf98acc0f6ee8d4ba0cae77830853ce6bf99576fa5fd92e9a28d43c0db1a269"}
Jul 01 20:47:41.384207 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.384182    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfr9n" event={"ID":"8a5942d3-fea9-4fab-b135-20321b55466f","Type":"ContainerStarted","Data":"54eb00dbbde1cc78e236f8a125e0941bc5e0c056c8d0f37d327635cfc4f5fbba"}
Jul 01 20:47:41.385897 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.385872    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6gj4t" event={"ID":"66b431e3-36ab-4c51-b88d-1337ae631aab","Type":"ContainerStarted","Data":"4e125dbc7877919e86e4365f7a454faf57e695007f7b27ab11172a5dfa70b4bb"}
Jul 01 20:47:41.443929 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.443655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b427af5-1151-49e3-b456-68d3633ba3be-audit-log\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.443929 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.443777    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-secret-metrics-server-client-certs\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.443929 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.443817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-client-ca-bundle\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.443929 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.443852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b427af5-1151-49e3-b456-68d3633ba3be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.443929 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.443901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p65t\" (UniqueName: \"kubernetes.io/projected/9b427af5-1151-49e3-b456-68d3633ba3be-kube-api-access-2p65t\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.444273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.444247    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b427af5-1151-49e3-b456-68d3633ba3be-metrics-server-audit-profiles\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.444577 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.444548    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-secret-metrics-server-tls\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.545987 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.545838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b427af5-1151-49e3-b456-68d3633ba3be-metrics-server-audit-profiles\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.545987 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.545889    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-secret-metrics-server-tls\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.545987 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.545932    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b427af5-1151-49e3-b456-68d3633ba3be-audit-log\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.545987 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.545968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-secret-metrics-server-client-certs\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.546261 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.546013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-client-ca-bundle\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.546261 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.546041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b427af5-1151-49e3-b456-68d3633ba3be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.546261 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.546066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p65t\" (UniqueName: \"kubernetes.io/projected/9b427af5-1151-49e3-b456-68d3633ba3be-kube-api-access-2p65t\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.546707 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.546656    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b427af5-1151-49e3-b456-68d3633ba3be-audit-log\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.546918 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.546896    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b427af5-1151-49e3-b456-68d3633ba3be-metrics-server-audit-profiles\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.547587 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.547522    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b427af5-1151-49e3-b456-68d3633ba3be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.549417 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.549377    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-secret-metrics-server-client-certs\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.549788 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.549746    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-client-ca-bundle\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.550218 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.550196    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b427af5-1151-49e3-b456-68d3633ba3be-secret-metrics-server-tls\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.556863 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.556822    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p65t\" (UniqueName: \"kubernetes.io/projected/9b427af5-1151-49e3-b456-68d3633ba3be-kube-api-access-2p65t\") pod \"metrics-server-8c7b78f5c-mh7jf\" (UID: \"9b427af5-1151-49e3-b456-68d3633ba3be\") " pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.631646 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.631612    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:41.636901 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.636661    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:47:41.637076 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.637053    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"]
Jul 01 20:47:41.639529 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.639509    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:41.642088 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.642068    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 01 20:47:41.642190 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.642117    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jcm76\""
Jul 01 20:47:41.656346 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.656321    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"]
Jul 01 20:47:41.736181 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.736154    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-njh65"]
Jul 01 20:47:41.738821 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.738799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-njh65"
Jul 01 20:47:41.741871 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.741851    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6t8gc\""
Jul 01 20:47:41.747294 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.746988    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 01 20:47:41.748110 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.747452    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 01 20:47:41.748110 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.747905    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrg6\" (UniqueName: \"kubernetes.io/projected/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-kube-api-access-pqrg6\") pod \"monitoring-plugin-cd8656b8-mnnqk\" (UID: \"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:41.748110 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.747959    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-mnnqk\" (UID: \"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:41.760823 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.760794    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-njh65"]
Jul 01 20:47:41.806332 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.806239    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:41.823829 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.823645    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"]
Jul 01 20:47:41.828776 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:41.828751    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b427af5_1151_49e3_b456_68d3633ba3be.slice/crio-fa7ade790f6838480756595a94fc2780125e8e98f9d6513e24d93b6ed98ba34a WatchSource:0}: Error finding container fa7ade790f6838480756595a94fc2780125e8e98f9d6513e24d93b6ed98ba34a: Status 404 returned error can't find the container with id fa7ade790f6838480756595a94fc2780125e8e98f9d6513e24d93b6ed98ba34a
Jul 01 20:47:41.848351 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.848325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrg6\" (UniqueName: \"kubernetes.io/projected/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-kube-api-access-pqrg6\") pod \"monitoring-plugin-cd8656b8-mnnqk\" (UID: \"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:41.848483 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.848442    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r59h\" (UniqueName: \"kubernetes.io/projected/37d180c8-3778-4623-956f-b548553fb89c-kube-api-access-8r59h\") pod \"downloads-5499b6fb8f-njh65\" (UID: \"37d180c8-3778-4623-956f-b548553fb89c\") " pod="openshift-console/downloads-5499b6fb8f-njh65"
Jul 01 20:47:41.848557 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.848502    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-mnnqk\" (UID: \"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:41.848683 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:41.848613    2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 01 20:47:41.848683 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:47:41.848673    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-monitoring-plugin-cert podName:8c5f4eb0-c973-43e8-a89f-48337b6cbc4f nodeName:}" failed. No retries permitted until 2026-07-01 20:47:42.348654239 +0000 UTC m=+67.944540535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-mnnqk" (UID: "8c5f4eb0-c973-43e8-a89f-48337b6cbc4f") : secret "monitoring-plugin-cert" not found
Jul 01 20:47:41.858180 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.858137    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrg6\" (UniqueName: \"kubernetes.io/projected/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-kube-api-access-pqrg6\") pod \"monitoring-plugin-cd8656b8-mnnqk\" (UID: \"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:41.881253 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.881228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:41.949205 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.949166    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r59h\" (UniqueName: \"kubernetes.io/projected/37d180c8-3778-4623-956f-b548553fb89c-kube-api-access-8r59h\") pod \"downloads-5499b6fb8f-njh65\" (UID: \"37d180c8-3778-4623-956f-b548553fb89c\") " pod="openshift-console/downloads-5499b6fb8f-njh65"
Jul 01 20:47:41.962521 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:41.962469    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r59h\" (UniqueName: \"kubernetes.io/projected/37d180c8-3778-4623-956f-b548553fb89c-kube-api-access-8r59h\") pod \"downloads-5499b6fb8f-njh65\" (UID: \"37d180c8-3778-4623-956f-b548553fb89c\") " pod="openshift-console/downloads-5499b6fb8f-njh65"
Jul 01 20:47:42.035700 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.035627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:42.057512 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.057435    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-njh65"
Jul 01 20:47:42.135802 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.135767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:42.352612 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.352583    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-mnnqk\" (UID: \"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:42.355617 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.355590    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c5f4eb0-c973-43e8-a89f-48337b6cbc4f-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-mnnqk\" (UID: \"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:42.394546 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.394510    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf" event={"ID":"9b427af5-1151-49e3-b456-68d3633ba3be","Type":"ContainerStarted","Data":"fa7ade790f6838480756595a94fc2780125e8e98f9d6513e24d93b6ed98ba34a"}
Jul 01 20:47:42.414406 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.414323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:42.470481 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.470445    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:42.571686 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.571185    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:42.616399 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.616328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:42.677853 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.677825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:42.822411 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.822370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:42.921664 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:42.921574    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:43.171450 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.171414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:43.308229 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.306874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:43.347907 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.346338    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-snkfr"
Jul 01 20:47:43.359676 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.359555    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-njh65"]
Jul 01 20:47:43.367145 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:43.367119    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d180c8_3778_4623_956f_b548553fb89c.slice/crio-413bcee5b65bdaf733151ed3ea7a19931837a58aaae5165813e2ca3bb52be328 WatchSource:0}: Error finding container 413bcee5b65bdaf733151ed3ea7a19931837a58aaae5165813e2ca3bb52be328: Status 404 returned error can't find the container with id 413bcee5b65bdaf733151ed3ea7a19931837a58aaae5165813e2ca3bb52be328
Jul 01 20:47:43.376912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.376820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:43.386456 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.385589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"]
Jul 01 20:47:43.398147 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:43.398104    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5f4eb0_c973_43e8_a89f_48337b6cbc4f.slice/crio-a2da163dfcee3cf7c2b9d35787cb67f6d7176a24fa4d7aaaad8b3c60855f2bb0 WatchSource:0}: Error finding container a2da163dfcee3cf7c2b9d35787cb67f6d7176a24fa4d7aaaad8b3c60855f2bb0: Status 404 returned error can't find the container with id a2da163dfcee3cf7c2b9d35787cb67f6d7176a24fa4d7aaaad8b3c60855f2bb0
Jul 01 20:47:43.404966 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.404940    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xw4rh" event={"ID":"4bbe856a-007f-4829-add8-0d49859c4df7","Type":"ContainerStarted","Data":"ca8bef7588743d7fb8dbdbfbd6255770a57f9d74911ff4b2b31dbd7fd06a7650"}
Jul 01 20:47:43.412050 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.411900    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-njh65" event={"ID":"37d180c8-3778-4623-956f-b548553fb89c","Type":"ContainerStarted","Data":"413bcee5b65bdaf733151ed3ea7a19931837a58aaae5165813e2ca3bb52be328"}
Jul 01 20:47:43.425496 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.425423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" event={"ID":"66b389f2-bea2-4f6f-8ff1-782354b3a79e","Type":"ContainerStarted","Data":"d1bc4d0a47b60b864cf778679f88bb73e64288ecfe6542d0d0679568f1aad197"}
Jul 01 20:47:43.446034 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.445960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:43.630051 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.629958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:43.989165 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:43.989099    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:44.433576 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.433538    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xw4rh" event={"ID":"4bbe856a-007f-4829-add8-0d49859c4df7","Type":"ContainerStarted","Data":"e50c88108eed60327e775b2a05864f4251f14803fa2d9c738711c0ad15f883ee"}
Jul 01 20:47:44.435403 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.435374    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk" event={"ID":"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f","Type":"ContainerStarted","Data":"a2da163dfcee3cf7c2b9d35787cb67f6d7176a24fa4d7aaaad8b3c60855f2bb0"}
Jul 01 20:47:44.438167 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.438140    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" event={"ID":"66b389f2-bea2-4f6f-8ff1-782354b3a79e","Type":"ContainerStarted","Data":"4274968f74a4a5fd3dafb24040fc38817fc665b1eaca52bb95e97e4736be58db"}
Jul 01 20:47:44.438276 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.438214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" event={"ID":"66b389f2-bea2-4f6f-8ff1-782354b3a79e","Type":"ContainerStarted","Data":"5f2f84d9a9bbd813b04414890bae1669e3084f734eef2a77b660be2c8e9fe306"}
Jul 01 20:47:44.454678 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.454626    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xw4rh" podStartSLOduration=67.539196798 podStartE2EDuration="1m9.454607498s" totalImagesPullingTime="1.9154107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:44.453493016 +0000 UTC m=+70.049379330" watchObservedRunningTime="2026-07-01 20:47:44.454607498 +0000 UTC m=+70.050493814"
Jul 01 20:47:44.559572 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.559492    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:44.659968 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.659901    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:44.845955 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.845922    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:44.945057 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:44.945023    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:46.047772 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.047735    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f679fb67b-mltmj"]
Jul 01 20:47:46.051315 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.051291    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.054892 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.054867    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 01 20:47:46.055112 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.055090    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 01 20:47:46.055112 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.055102    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 01 20:47:46.055231 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.055158    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qjb6t\""
Jul 01 20:47:46.055231 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.055100    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 01 20:47:46.055325 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.055268    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 01 20:47:46.060880 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.060859    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f679fb67b-mltmj"]
Jul 01 20:47:46.088701 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.088604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-service-ca\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.088701 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.088643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-serving-cert\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.088701 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.088667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-config\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.088701 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.088692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-oauth-serving-cert\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.088981 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.088761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-oauth-config\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.088981 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.088782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmlj\" (UniqueName: \"kubernetes.io/projected/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-kube-api-access-dqmlj\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.189368 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.189340    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-oauth-config\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.189514 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.189380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmlj\" (UniqueName: \"kubernetes.io/projected/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-kube-api-access-dqmlj\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.189514 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.189457    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-service-ca\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.189514 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.189484    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-serving-cert\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.189514 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.189506    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-config\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.189699 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.189528    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-oauth-serving-cert\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.190277 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.190249    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-config\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.190389 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.190295    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-service-ca\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.190389 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.190379    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-oauth-serving-cert\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.192312 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.192286    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-oauth-config\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.192512 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.192488    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-serving-cert\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.198049 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.197537    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmlj\" (UniqueName: \"kubernetes.io/projected/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-kube-api-access-dqmlj\") pod \"console-f679fb67b-mltmj\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") " pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.365857 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.365759    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:46.709179 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.709097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:46.809539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:46.809497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:47.233061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:47.233022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:47.307827 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:47.307791    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:48.287907 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.287564    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f679fb67b-mltmj"]
Jul 01 20:47:48.299304 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:47:48.299272    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e37df69_ab21_45b9_ae54_b8e76e2cf4f7.slice/crio-818544cc056e2d529f8a7e19fe7450e9921de8a9f95616851db52d1672efe99f WatchSource:0}: Error finding container 818544cc056e2d529f8a7e19fe7450e9921de8a9f95616851db52d1672efe99f: Status 404 returned error can't find the container with id 818544cc056e2d529f8a7e19fe7450e9921de8a9f95616851db52d1672efe99f
Jul 01 20:47:48.464976 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.464197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf" event={"ID":"9b427af5-1151-49e3-b456-68d3633ba3be","Type":"ContainerStarted","Data":"e55856869b7ba46146afa82add9e59deda9c62f9a229e3913d3f338dc99fb701"}
Jul 01 20:47:48.468793 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.467442    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfr9n" event={"ID":"8a5942d3-fea9-4fab-b135-20321b55466f","Type":"ContainerStarted","Data":"ecac063be5ad20fbd6bc03fd5c4d6b4054330a83b67e50c615cbb2f4004d0277"}
Jul 01 20:47:48.471945 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.471897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6gj4t" event={"ID":"66b431e3-36ab-4c51-b88d-1337ae631aab","Type":"ContainerStarted","Data":"f2919c808125042097390a94022d09534c40b6f4985c627c8fbc09aa2f7238d0"}
Jul 01 20:47:48.472148 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.472117    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:47:48.473590 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.473567    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk" event={"ID":"8c5f4eb0-c973-43e8-a89f-48337b6cbc4f","Type":"ContainerStarted","Data":"828e981a1d4741f4b59ea2ff312bd2d9295403a2f6daee9d13e3de17fd8eb96e"}
Jul 01 20:47:48.474050 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.474031    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:48.478142 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.478119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" event={"ID":"66b389f2-bea2-4f6f-8ff1-782354b3a79e","Type":"ContainerStarted","Data":"acdf25e94bc585736c497a09bb27417c88e41ad0f08e7523ba678d6bbf1c670e"}
Jul 01 20:47:48.478246 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.478202    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" event={"ID":"66b389f2-bea2-4f6f-8ff1-782354b3a79e","Type":"ContainerStarted","Data":"ff1a853076583ef692e10e10d4a1e6814c18e575c9ea533198bbb14cf487634f"}
Jul 01 20:47:48.478300 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.478261    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" event={"ID":"66b389f2-bea2-4f6f-8ff1-782354b3a79e","Type":"ContainerStarted","Data":"713f88b2c3e0297e756bb03e3c32618cb68d1a63658af8d30cb56badb5d1c366"}
Jul 01 20:47:48.480475 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.480452    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:48.483313 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.482534    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk"
Jul 01 20:47:48.483313 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.482742    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679fb67b-mltmj" event={"ID":"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7","Type":"ContainerStarted","Data":"818544cc056e2d529f8a7e19fe7450e9921de8a9f95616851db52d1672efe99f"}
Jul 01 20:47:48.489020 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.484667    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf" podStartSLOduration=1.20942541 podStartE2EDuration="7.484652457s" totalImagesPullingTime="6.275227047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:48.483141569 +0000 UTC m=+74.079027882" watchObservedRunningTime="2026-07-01 20:47:48.484652457 +0000 UTC m=+74.080538771"
Jul 01 20:47:48.497651 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.497634    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6"
Jul 01 20:47:48.529294 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.529228    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bfr9n" podStartSLOduration=66.455533154 podStartE2EDuration="1m13.529209258s" totalImagesPullingTime="7.073676104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:48.5058628 +0000 UTC m=+74.101749113" watchObservedRunningTime="2026-07-01 20:47:48.529209258 +0000 UTC m=+74.125095572"
Jul 01 20:47:48.531190 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.531143    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d97ff7b86-c82n6" podStartSLOduration=2.0701840049999998 podStartE2EDuration="9.531124407s" totalImagesPullingTime="7.460940402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:48.528817812 +0000 UTC m=+74.124704126" watchObservedRunningTime="2026-07-01 20:47:48.531124407 +0000 UTC m=+74.127010721"
Jul 01 20:47:48.552988 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.549626    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6gj4t" podStartSLOduration=66.706140648 podStartE2EDuration="1m13.54960014s" totalImagesPullingTime="6.843459492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:48.548687035 +0000 UTC m=+74.144573374" watchObservedRunningTime="2026-07-01 20:47:48.54960014 +0000 UTC m=+74.145486432"
Jul 01 20:47:48.570963 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:48.570457    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mnnqk" podStartSLOduration=2.870118007 podStartE2EDuration="7.570437038s" totalImagesPullingTime="4.700319031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:48.5687161 +0000 UTC m=+74.164602415" watchObservedRunningTime="2026-07-01 20:47:48.570437038 +0000 UTC m=+74.166323368"
Jul 01 20:47:49.438550 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:49.438512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:49.537704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:49.537644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:51.498810 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:51.498742    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679fb67b-mltmj" event={"ID":"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7","Type":"ContainerStarted","Data":"5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db"}
Jul 01 20:47:51.518651 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:51.518594    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f679fb67b-mltmj" podStartSLOduration=2.479784284 podStartE2EDuration="5.518573089s" totalImagesPullingTime="3.038788805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:51.516259558 +0000 UTC m=+77.112145871" watchObservedRunningTime="2026-07-01 20:47:51.518573089 +0000 UTC m=+77.114459404"
Jul 01 20:47:53.247474 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:53.247443    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:53.922754 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:53.922719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:54.030423 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:54.030372    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:55.070171 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.070133    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6889cdc4-nchd8"]
Jul 01 20:47:55.073935 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.073915    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.083579 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.083557    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 01 20:47:55.092507 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.092481    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6889cdc4-nchd8"]
Jul 01 20:47:55.169078 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.169048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwl6g\" (UniqueName: \"kubernetes.io/projected/cb3638b8-f140-42da-ad94-c7ba8ad5486f-kube-api-access-hwl6g\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.169264 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.169106    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-service-ca\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.169264 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.169153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-trusted-ca-bundle\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.169264 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.169179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-oauth-serving-cert\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.169264 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.169213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-serving-cert\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.169264 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.169237    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-config\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.169508 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.169303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-oauth-config\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.270682 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.270643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-service-ca\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.270834 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.270696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-trusted-ca-bundle\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.270834 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.270722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-oauth-serving-cert\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.270970 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.270839    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-serving-cert\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.270970 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.270886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-config\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.270970 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.270941    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-oauth-config\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.271137 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.271040    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwl6g\" (UniqueName: \"kubernetes.io/projected/cb3638b8-f140-42da-ad94-c7ba8ad5486f-kube-api-access-hwl6g\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.271542 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.271520    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-oauth-serving-cert\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.271542 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.271536    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-service-ca\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.271793 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.271770    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-config\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.272014 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.271972    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-trusted-ca-bundle\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.273640 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.273618    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-serving-cert\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.273815 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.273794    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-oauth-config\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.279818 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.279795    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwl6g\" (UniqueName: \"kubernetes.io/projected/cb3638b8-f140-42da-ad94-c7ba8ad5486f-kube-api-access-hwl6g\") pod \"console-c6889cdc4-nchd8\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") " pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:55.385698 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:55.385676    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:47:56.063674 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:56.063640    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:56.162013 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:56.161957    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:56.366791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:56.366760    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:56.366970 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:56.366829    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:56.373071 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:56.373050    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:56.525971 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:56.525939    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:47:57.035496 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:57.035464    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:57.134385 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:57.134357    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:57.240856 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:57.240824    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:58.301119 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:58.301088    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:58.402122 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:58.402088    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:59.085258 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:59.085218    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:47:59.141730 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:47:59.141692    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:00.875172 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:00.875144    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6889cdc4-nchd8"]
Jul 01 20:48:00.878072 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:48:00.878037    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3638b8_f140_42da_ad94_c7ba8ad5486f.slice/crio-c52f6e025e54e1f920b9b91a76e563f3044a23e2dff158c0894d1696c4294c8c WatchSource:0}: Error finding container c52f6e025e54e1f920b9b91a76e563f3044a23e2dff158c0894d1696c4294c8c: Status 404 returned error can't find the container with id c52f6e025e54e1f920b9b91a76e563f3044a23e2dff158c0894d1696c4294c8c
Jul 01 20:48:01.545452 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.545421    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6889cdc4-nchd8" event={"ID":"cb3638b8-f140-42da-ad94-c7ba8ad5486f","Type":"ContainerStarted","Data":"418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af"}
Jul 01 20:48:01.545740 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.545543    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6889cdc4-nchd8" event={"ID":"cb3638b8-f140-42da-ad94-c7ba8ad5486f","Type":"ContainerStarted","Data":"c52f6e025e54e1f920b9b91a76e563f3044a23e2dff158c0894d1696c4294c8c"}
Jul 01 20:48:01.547091 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.547065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-njh65" event={"ID":"37d180c8-3778-4623-956f-b548553fb89c","Type":"ContainerStarted","Data":"3e39a0e180d2b3c5fb43ed710a308c46192930e3fa553fe8a9d49d5a10f19a79"}
Jul 01 20:48:01.547595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.547570    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-njh65"
Jul 01 20:48:01.562869 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.562848    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-njh65"
Jul 01 20:48:01.565203 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.565127    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6889cdc4-nchd8" podStartSLOduration=6.5651142 podStartE2EDuration="6.5651142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:01.563379711 +0000 UTC m=+87.159266027" watchObservedRunningTime="2026-07-01 20:48:01.5651142 +0000 UTC m=+87.161000513"
Jul 01 20:48:01.581767 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.581727    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-njh65" podStartSLOduration=2.826943986 podStartE2EDuration="20.581708897s" totalImagesPullingTime="17.754764911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:01.580293213 +0000 UTC m=+87.176179527" watchObservedRunningTime="2026-07-01 20:48:01.581708897 +0000 UTC m=+87.177595212"
Jul 01 20:48:01.637515 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.637489    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:48:01.638048 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.638024    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:48:01.738441 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.738406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:01.838550 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:01.838518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:05.052812 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:05.052771    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:05.182945 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:05.182907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:05.386084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:05.386055    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:48:05.386252 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:05.386138    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:48:05.391655 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:05.391628    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:48:05.570400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:05.570363    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:48:05.618749 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:05.618721    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f679fb67b-mltmj"]
Jul 01 20:48:07.055053 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:07.054989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:07.124366 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:07.124337    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:07.860458 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:07.860428    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:07.929361 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:07.929333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:08.497260 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:08.497223    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:08.567747 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:08.567680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:09.133159 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:09.133094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:09.233414 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:09.233387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:16.709880 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:16.709820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:16.808743 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:16.808707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:19.491103 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:19.491063    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6gj4t"
Jul 01 20:48:21.642786 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:21.642755    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:48:21.646968 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:21.646946    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8c7b78f5c-mh7jf"
Jul 01 20:48:30.647791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.647719    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f679fb67b-mltmj" podUID="3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" containerName="console" containerID="cri-o://5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db" gracePeriod=15
Jul 01 20:48:30.909121 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.909070    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:48:30.942698 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.942674    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-serving-cert\") pod \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") "
Jul 01 20:48:30.942811 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.942704    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-oauth-serving-cert\") pod \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") "
Jul 01 20:48:30.942811 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.942746    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-oauth-config\") pod \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") "
Jul 01 20:48:30.942811 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.942779    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-service-ca\") pod \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") "
Jul 01 20:48:30.942982 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.942833    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqmlj\" (UniqueName: \"kubernetes.io/projected/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-kube-api-access-dqmlj\") pod \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") "
Jul 01 20:48:30.942982 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.942886    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-config\") pod \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\" (UID: \"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7\") "
Jul 01 20:48:30.943128 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.943105    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" (UID: "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:48:30.943225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.943190    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" (UID: "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:48:30.943346 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.943319    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-config" (OuterVolumeSpecName: "console-config") pod "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" (UID: "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:48:30.944882 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.944853    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" (UID: "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:48:30.944970 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.944940    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" (UID: "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:48:30.945028 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:30.944958    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-kube-api-access-dqmlj" (OuterVolumeSpecName: "kube-api-access-dqmlj") pod "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" (UID: "3e37df69-ab21-45b9-ae54-b8e76e2cf4f7"). InnerVolumeSpecName "kube-api-access-dqmlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:48:31.043637 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.043618    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:48:31.043637 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.043638    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:48:31.043637 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.043647    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-oauth-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:48:31.043785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.043655    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-console-oauth-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:48:31.043785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.043664    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-service-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:48:31.043785 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.043671    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqmlj\" (UniqueName: \"kubernetes.io/projected/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7-kube-api-access-dqmlj\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:48:31.673323 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.673295    2569 generic.go:356] "Generic (PLEG): container finished" podID="3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" containerID="5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db" exitCode=0
Jul 01 20:48:31.673677 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.673341    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679fb67b-mltmj"
Jul 01 20:48:31.673677 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.673367    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679fb67b-mltmj" event={"ID":"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7","Type":"ContainerDied","Data":"5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db"}
Jul 01 20:48:31.673677 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.673408    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679fb67b-mltmj" event={"ID":"3e37df69-ab21-45b9-ae54-b8e76e2cf4f7","Type":"ContainerDied","Data":"818544cc056e2d529f8a7e19fe7450e9921de8a9f95616851db52d1672efe99f"}
Jul 01 20:48:31.673677 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.673427    2569 scope.go:117] "RemoveContainer" containerID="5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db"
Jul 01 20:48:31.686047 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.686031    2569 scope.go:117] "RemoveContainer" containerID="5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db"
Jul 01 20:48:31.686328 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:48:31.686305    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db\": container with ID starting with 5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db not found: ID does not exist" containerID="5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db"
Jul 01 20:48:31.686431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.686333    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db"} err="failed to get container status \"5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db\": rpc error: code = NotFound desc = could not find container \"5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db\": container with ID starting with 5c85198b54816c214ddb2afcec3d5447bb6ddfca907cdbcd7643d2da1567e7db not found: ID does not exist"
Jul 01 20:48:31.692860 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.692836    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f679fb67b-mltmj"]
Jul 01 20:48:31.696751 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.696731    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f679fb67b-mltmj"]
Jul 01 20:48:31.706718 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.706675    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:31.770869 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:31.770844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:32.963439 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:32.963403    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" path="/var/lib/kubelet/pods/3e37df69-ab21-45b9-ae54-b8e76e2cf4f7/volumes"
Jul 01 20:48:34.763467 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:34.763440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:34.816842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:34.816819    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:56.091720 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:56.091679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:48:56.413788 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:48:56.413687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:05.315187 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.315156    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc8555bb7-ng5zx"]
Jul 01 20:49:05.315726 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.315432    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" containerName="console"
Jul 01 20:49:05.315726 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.315444    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" containerName="console"
Jul 01 20:49:05.315726 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.315505    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e37df69-ab21-45b9-ae54-b8e76e2cf4f7" containerName="console"
Jul 01 20:49:05.317360 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.317344    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.336333 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.336307    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc8555bb7-ng5zx"]
Jul 01 20:49:05.378615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.378591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-trusted-ca-bundle\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.378754 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.378636    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-console-config\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.378754 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.378702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-oauth-serving-cert\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.378754 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.378747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-oauth-config\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.378908 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.378792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5dj\" (UniqueName: \"kubernetes.io/projected/1ddba8c7-7c62-4165-aa41-674d624b5621-kube-api-access-fh5dj\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.378908 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.378825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-serving-cert\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.378908 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.378870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-service-ca\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.379465 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.379441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:05.479915 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.479880    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-trusted-ca-bundle\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.480076 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.479938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-console-config\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.480076 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.479964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-oauth-serving-cert\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.480076 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.479984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-oauth-config\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.480076 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.480032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5dj\" (UniqueName: \"kubernetes.io/projected/1ddba8c7-7c62-4165-aa41-674d624b5621-kube-api-access-fh5dj\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.480076 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.480065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-serving-cert\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.480351 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.480159    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-service-ca\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.480930 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.480904    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-console-config\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.481078 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.480919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-trusted-ca-bundle\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.481442 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.481379    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-oauth-serving-cert\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.481581 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.481562    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-service-ca\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.483427 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.483405    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-serving-cert\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.483498 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.483401    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-oauth-config\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.488095 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.488073    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:05.490595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.490577    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5dj\" (UniqueName: \"kubernetes.io/projected/1ddba8c7-7c62-4165-aa41-674d624b5621-kube-api-access-fh5dj\") pod \"console-6cc8555bb7-ng5zx\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") " pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.625740 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.625703    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:05.759367 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.759344    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc8555bb7-ng5zx"]
Jul 01 20:49:05.761658 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:49:05.761638    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ddba8c7_7c62_4165_aa41_674d624b5621.slice/crio-1d19dd643f4f04026d374e548a9472b35b595198c3ce970507b071f95058c0b3 WatchSource:0}: Error finding container 1d19dd643f4f04026d374e548a9472b35b595198c3ce970507b071f95058c0b3: Status 404 returned error can't find the container with id 1d19dd643f4f04026d374e548a9472b35b595198c3ce970507b071f95058c0b3
Jul 01 20:49:05.803400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:05.803379    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc8555bb7-ng5zx" event={"ID":"1ddba8c7-7c62-4165-aa41-674d624b5621","Type":"ContainerStarted","Data":"1d19dd643f4f04026d374e548a9472b35b595198c3ce970507b071f95058c0b3"}
Jul 01 20:49:06.810202 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:06.810158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc8555bb7-ng5zx" event={"ID":"1ddba8c7-7c62-4165-aa41-674d624b5621","Type":"ContainerStarted","Data":"b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed"}
Jul 01 20:49:06.828443 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:06.828390    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cc8555bb7-ng5zx" podStartSLOduration=1.82837528 podStartE2EDuration="1.82837528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:49:06.827037122 +0000 UTC m=+152.422923436" watchObservedRunningTime="2026-07-01 20:49:06.82837528 +0000 UTC m=+152.424261592"
Jul 01 20:49:15.626487 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:15.626455    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:15.626972 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:15.626504    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:15.631068 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:15.631044    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:15.849644 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:15.849618    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:49:15.894882 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:15.894813    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6889cdc4-nchd8"]
Jul 01 20:49:16.033349 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:16.033318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:16.133837 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:16.133803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:16.194297 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:16.194234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:39.250660 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:39.250613    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:39.313882 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:39.313849    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:49:40.915795 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:40.915747    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c6889cdc4-nchd8" podUID="cb3638b8-f140-42da-ad94-c7ba8ad5486f" containerName="console" containerID="cri-o://418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af" gracePeriod=15
Jul 01 20:49:41.165073 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.165053    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:49:41.237748 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.237688    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-serving-cert\") pod \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") "
Jul 01 20:49:41.237748 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.237724    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-service-ca\") pod \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") "
Jul 01 20:49:41.237918 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.237759    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-trusted-ca-bundle\") pod \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") "
Jul 01 20:49:41.237918 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.237892    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-config\") pod \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") "
Jul 01 20:49:41.238051 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.237934    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-oauth-serving-cert\") pod \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") "
Jul 01 20:49:41.238051 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-oauth-config\") pod \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") "
Jul 01 20:49:41.238159 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238063    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwl6g\" (UniqueName: \"kubernetes.io/projected/cb3638b8-f140-42da-ad94-c7ba8ad5486f-kube-api-access-hwl6g\") pod \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\" (UID: \"cb3638b8-f140-42da-ad94-c7ba8ad5486f\") "
Jul 01 20:49:41.238229 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238206    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cb3638b8-f140-42da-ad94-c7ba8ad5486f" (UID: "cb3638b8-f140-42da-ad94-c7ba8ad5486f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:49:41.238290 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238222    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-config" (OuterVolumeSpecName: "console-config") pod "cb3638b8-f140-42da-ad94-c7ba8ad5486f" (UID: "cb3638b8-f140-42da-ad94-c7ba8ad5486f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:49:41.238290 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238204    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-service-ca" (OuterVolumeSpecName: "service-ca") pod "cb3638b8-f140-42da-ad94-c7ba8ad5486f" (UID: "cb3638b8-f140-42da-ad94-c7ba8ad5486f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:49:41.238400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238294    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cb3638b8-f140-42da-ad94-c7ba8ad5486f" (UID: "cb3638b8-f140-42da-ad94-c7ba8ad5486f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:49:41.238400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238312    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-service-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:49:41.238400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238327    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:49:41.238400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.238341    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:49:41.239975 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.239953    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cb3638b8-f140-42da-ad94-c7ba8ad5486f" (UID: "cb3638b8-f140-42da-ad94-c7ba8ad5486f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:49:41.240082 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.239969    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cb3638b8-f140-42da-ad94-c7ba8ad5486f" (UID: "cb3638b8-f140-42da-ad94-c7ba8ad5486f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:49:41.240139 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.240123    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3638b8-f140-42da-ad94-c7ba8ad5486f-kube-api-access-hwl6g" (OuterVolumeSpecName: "kube-api-access-hwl6g") pod "cb3638b8-f140-42da-ad94-c7ba8ad5486f" (UID: "cb3638b8-f140-42da-ad94-c7ba8ad5486f"). InnerVolumeSpecName "kube-api-access-hwl6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:49:41.339273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.339250    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-oauth-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:49:41.339273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.339269    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwl6g\" (UniqueName: \"kubernetes.io/projected/cb3638b8-f140-42da-ad94-c7ba8ad5486f-kube-api-access-hwl6g\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:49:41.339389 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.339279    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3638b8-f140-42da-ad94-c7ba8ad5486f-console-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:49:41.339389 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.339288    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb3638b8-f140-42da-ad94-c7ba8ad5486f-oauth-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:49:41.947107 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.947067    2569 generic.go:356] "Generic (PLEG): container finished" podID="cb3638b8-f140-42da-ad94-c7ba8ad5486f" containerID="418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af" exitCode=0
Jul 01 20:49:41.947569 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.947123    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6889cdc4-nchd8"
Jul 01 20:49:41.947569 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.947166    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6889cdc4-nchd8" event={"ID":"cb3638b8-f140-42da-ad94-c7ba8ad5486f","Type":"ContainerDied","Data":"418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af"}
Jul 01 20:49:41.947569 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.947252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6889cdc4-nchd8" event={"ID":"cb3638b8-f140-42da-ad94-c7ba8ad5486f","Type":"ContainerDied","Data":"c52f6e025e54e1f920b9b91a76e563f3044a23e2dff158c0894d1696c4294c8c"}
Jul 01 20:49:41.947569 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.947285    2569 scope.go:117] "RemoveContainer" containerID="418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af"
Jul 01 20:49:41.957377 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.957358    2569 scope.go:117] "RemoveContainer" containerID="418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af"
Jul 01 20:49:41.957672 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:49:41.957650    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af\": container with ID starting with 418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af not found: ID does not exist" containerID="418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af"
Jul 01 20:49:41.957728 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.957683    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af"} err="failed to get container status \"418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af\": rpc error: code = NotFound desc = could not find container \"418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af\": container with ID starting with 418f4693d86b27426ffcadc2c249885e3156414cbe8fb1a99321867609d471af not found: ID does not exist"
Jul 01 20:49:41.981226 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.981194    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6889cdc4-nchd8"]
Jul 01 20:49:41.985045 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:41.985015    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6889cdc4-nchd8"]
Jul 01 20:49:42.963195 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:49:42.963156    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3638b8-f140-42da-ad94-c7ba8ad5486f" path="/var/lib/kubelet/pods/cb3638b8-f140-42da-ad94-c7ba8ad5486f/volumes"
Jul 01 20:50:11.405935 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:11.405887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:11.976905 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:11.976863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:23.432871 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:23.432834    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:23.533663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:23.533636    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:31.714205 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:31.714162    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:31.814480 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:31.814451    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:41.776106 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.776068    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6dfc47bf-cmfrl"]
Jul 01 20:50:41.776595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.776472    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3638b8-f140-42da-ad94-c7ba8ad5486f" containerName="console"
Jul 01 20:50:41.776595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.776490    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3638b8-f140-42da-ad94-c7ba8ad5486f" containerName="console"
Jul 01 20:50:41.776595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.776571    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3638b8-f140-42da-ad94-c7ba8ad5486f" containerName="console"
Jul 01 20:50:41.779277 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.779243    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.806940 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.806920    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6dfc47bf-cmfrl"]
Jul 01 20:50:41.845275 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.845250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:41.854387 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.854364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-service-ca\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.854494 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.854412    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-config\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.854494 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.854438    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-oauth-config\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.854494 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.854475    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-oauth-serving-cert\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.854608 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.854529    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwd4x\" (UniqueName: \"kubernetes.io/projected/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-kube-api-access-dwd4x\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.854608 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.854555    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-serving-cert\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.854608 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.854576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-trusted-ca-bundle\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.900344 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.900323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:41.955381 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.955362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-trusted-ca-bundle\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.955474 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.955399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-service-ca\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.955474 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.955423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-config\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.955577 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.955542    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-oauth-config\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.955631 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.955576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-oauth-serving-cert\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.955631 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.955618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwd4x\" (UniqueName: \"kubernetes.io/projected/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-kube-api-access-dwd4x\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.955739 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.955660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-serving-cert\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.956275 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.956251    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-config\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.956390 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.956344    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-trusted-ca-bundle\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.956390 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.956349    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-oauth-serving-cert\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.956390 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.956355    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-service-ca\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.958087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.958064    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-serving-cert\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.958174 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.958139    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-oauth-config\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:41.963974 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:41.963952    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwd4x\" (UniqueName: \"kubernetes.io/projected/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-kube-api-access-dwd4x\") pod \"console-5c6dfc47bf-cmfrl\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") " pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:42.090722 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:42.090700    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:42.215137 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:42.215048    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6dfc47bf-cmfrl"]
Jul 01 20:50:42.217681 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:50:42.217652    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38d2da4_f4cf_450b_a8ac_bb2939338d7a.slice/crio-a69b09efaea110daa1e01823b80a151fae19e69b8582085ccbd4c95a0d76ef76 WatchSource:0}: Error finding container a69b09efaea110daa1e01823b80a151fae19e69b8582085ccbd4c95a0d76ef76: Status 404 returned error can't find the container with id a69b09efaea110daa1e01823b80a151fae19e69b8582085ccbd4c95a0d76ef76
Jul 01 20:50:43.181073 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:43.181033    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dfc47bf-cmfrl" event={"ID":"f38d2da4-f4cf-450b-a8ac-bb2939338d7a","Type":"ContainerStarted","Data":"4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49"}
Jul 01 20:50:43.181456 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:43.181090    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dfc47bf-cmfrl" event={"ID":"f38d2da4-f4cf-450b-a8ac-bb2939338d7a","Type":"ContainerStarted","Data":"a69b09efaea110daa1e01823b80a151fae19e69b8582085ccbd4c95a0d76ef76"}
Jul 01 20:50:43.200633 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:43.200579    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6dfc47bf-cmfrl" podStartSLOduration=2.200562683 podStartE2EDuration="2.200562683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:50:43.198620482 +0000 UTC m=+248.794506796" watchObservedRunningTime="2026-07-01 20:50:43.200562683 +0000 UTC m=+248.796448996"
Jul 01 20:50:52.091391 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.091347    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:52.091826 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.091422    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:52.096246 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.096219    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:52.218618 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.218590    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:50:52.275533 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.275502    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc8555bb7-ng5zx"]
Jul 01 20:50:52.394191 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.394131    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:52.495676 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.495648    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:50:52.559152 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:50:52.559125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:07.191576 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:07.191500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:07.258701 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:07.258672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:07.386560 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:07.386530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:07.587770 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:07.587739    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:07.683165 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:07.683141    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:08.437033 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.436985    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"]
Jul 01 20:51:08.439466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.439446    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.442170 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.442150    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-282rv\""
Jul 01 20:51:08.442335 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.442316    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 01 20:51:08.442981 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.442964    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 01 20:51:08.451559 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.451536    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"]
Jul 01 20:51:08.544495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.544465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.544633 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.544519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2mh2\" (UniqueName: \"kubernetes.io/projected/ede1da24-58f9-4942-a1dd-2b2148fc0e72-kube-api-access-q2mh2\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.544633 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.544548    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.645772 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.645725    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2mh2\" (UniqueName: \"kubernetes.io/projected/ede1da24-58f9-4942-a1dd-2b2148fc0e72-kube-api-access-q2mh2\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.645922 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.645785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.645922 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.645841    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.646222 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.646203    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.646262 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.646234    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.655394 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.655374    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2mh2\" (UniqueName: \"kubernetes.io/projected/ede1da24-58f9-4942-a1dd-2b2148fc0e72-kube-api-access-q2mh2\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.748772 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.748708    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:08.869442 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:08.869408    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"]
Jul 01 20:51:08.872301 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:51:08.872276    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede1da24_58f9_4942_a1dd_2b2148fc0e72.slice/crio-c53f55c6f538dd2c6f049cfe313047a9879e7df857143854b46a9f25c240fe40 WatchSource:0}: Error finding container c53f55c6f538dd2c6f049cfe313047a9879e7df857143854b46a9f25c240fe40: Status 404 returned error can't find the container with id c53f55c6f538dd2c6f049cfe313047a9879e7df857143854b46a9f25c240fe40
Jul 01 20:51:09.278403 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:09.278375    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5" event={"ID":"ede1da24-58f9-4942-a1dd-2b2148fc0e72","Type":"ContainerStarted","Data":"c53f55c6f538dd2c6f049cfe313047a9879e7df857143854b46a9f25c240fe40"}
Jul 01 20:51:17.295584 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.295529    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cc8555bb7-ng5zx" podUID="1ddba8c7-7c62-4165-aa41-674d624b5621" containerName="console" containerID="cri-o://b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed" gracePeriod=15
Jul 01 20:51:17.310865 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.310840    2569 generic.go:356] "Generic (PLEG): container finished" podID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerID="34a575f301a9f1634f991206204acbfb790d5fecf08b8441043d9a1cebd3a9c7" exitCode=0
Jul 01 20:51:17.310946 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.310919    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5" event={"ID":"ede1da24-58f9-4942-a1dd-2b2148fc0e72","Type":"ContainerDied","Data":"34a575f301a9f1634f991206204acbfb790d5fecf08b8441043d9a1cebd3a9c7"}
Jul 01 20:51:17.532245 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.532226    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:51:17.611305 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611279    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh5dj\" (UniqueName: \"kubernetes.io/projected/1ddba8c7-7c62-4165-aa41-674d624b5621-kube-api-access-fh5dj\") pod \"1ddba8c7-7c62-4165-aa41-674d624b5621\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") "
Jul 01 20:51:17.611426 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611330    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-oauth-config\") pod \"1ddba8c7-7c62-4165-aa41-674d624b5621\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") "
Jul 01 20:51:17.611426 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611373    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-trusted-ca-bundle\") pod \"1ddba8c7-7c62-4165-aa41-674d624b5621\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") "
Jul 01 20:51:17.611426 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611408    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-service-ca\") pod \"1ddba8c7-7c62-4165-aa41-674d624b5621\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") "
Jul 01 20:51:17.611588 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611454    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-console-config\") pod \"1ddba8c7-7c62-4165-aa41-674d624b5621\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") "
Jul 01 20:51:17.611588 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611485    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-oauth-serving-cert\") pod \"1ddba8c7-7c62-4165-aa41-674d624b5621\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") "
Jul 01 20:51:17.611588 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611540    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-serving-cert\") pod \"1ddba8c7-7c62-4165-aa41-674d624b5621\" (UID: \"1ddba8c7-7c62-4165-aa41-674d624b5621\") "
Jul 01 20:51:17.611802 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611775    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1ddba8c7-7c62-4165-aa41-674d624b5621" (UID: "1ddba8c7-7c62-4165-aa41-674d624b5621"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:51:17.611802 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611793    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ddba8c7-7c62-4165-aa41-674d624b5621" (UID: "1ddba8c7-7c62-4165-aa41-674d624b5621"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:51:17.611919 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.611872    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-console-config" (OuterVolumeSpecName: "console-config") pod "1ddba8c7-7c62-4165-aa41-674d624b5621" (UID: "1ddba8c7-7c62-4165-aa41-674d624b5621"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:51:17.612116 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.612096    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ddba8c7-7c62-4165-aa41-674d624b5621" (UID: "1ddba8c7-7c62-4165-aa41-674d624b5621"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:51:17.613324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.613302    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ddba8c7-7c62-4165-aa41-674d624b5621" (UID: "1ddba8c7-7c62-4165-aa41-674d624b5621"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:51:17.613430 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.613395    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ddba8c7-7c62-4165-aa41-674d624b5621-kube-api-access-fh5dj" (OuterVolumeSpecName: "kube-api-access-fh5dj") pod "1ddba8c7-7c62-4165-aa41-674d624b5621" (UID: "1ddba8c7-7c62-4165-aa41-674d624b5621"). InnerVolumeSpecName "kube-api-access-fh5dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:51:17.613676 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.613651    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ddba8c7-7c62-4165-aa41-674d624b5621" (UID: "1ddba8c7-7c62-4165-aa41-674d624b5621"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:51:17.712820 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.712798    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-oauth-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:17.712820 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.712820    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:17.712938 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.712829    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-service-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:17.712938 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.712837    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-console-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:17.712938 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.712845    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ddba8c7-7c62-4165-aa41-674d624b5621-oauth-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:17.712938 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.712853    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ddba8c7-7c62-4165-aa41-674d624b5621-console-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:17.712938 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:17.712861    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh5dj\" (UniqueName: \"kubernetes.io/projected/1ddba8c7-7c62-4165-aa41-674d624b5621-kube-api-access-fh5dj\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:18.318273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.317957    2569 generic.go:356] "Generic (PLEG): container finished" podID="1ddba8c7-7c62-4165-aa41-674d624b5621" containerID="b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed" exitCode=0
Jul 01 20:51:18.318273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.318031    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc8555bb7-ng5zx"
Jul 01 20:51:18.318273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.318043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc8555bb7-ng5zx" event={"ID":"1ddba8c7-7c62-4165-aa41-674d624b5621","Type":"ContainerDied","Data":"b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed"}
Jul 01 20:51:18.318273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.318087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc8555bb7-ng5zx" event={"ID":"1ddba8c7-7c62-4165-aa41-674d624b5621","Type":"ContainerDied","Data":"1d19dd643f4f04026d374e548a9472b35b595198c3ce970507b071f95058c0b3"}
Jul 01 20:51:18.318273 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.318113    2569 scope.go:117] "RemoveContainer" containerID="b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed"
Jul 01 20:51:18.328897 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.328874    2569 scope.go:117] "RemoveContainer" containerID="b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed"
Jul 01 20:51:18.329206 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:18.329185    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed\": container with ID starting with b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed not found: ID does not exist" containerID="b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed"
Jul 01 20:51:18.329293 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.329213    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed"} err="failed to get container status \"b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed\": rpc error: code = NotFound desc = could not find container \"b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed\": container with ID starting with b20793749ef793efa2a3dba315133c9dea268609f615b1f55bd37999ebf516ed not found: ID does not exist"
Jul 01 20:51:18.344269 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.344247    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc8555bb7-ng5zx"]
Jul 01 20:51:18.350781 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.350759    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc8555bb7-ng5zx"]
Jul 01 20:51:18.969429 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:18.969396    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ddba8c7-7c62-4165-aa41-674d624b5621" path="/var/lib/kubelet/pods/1ddba8c7-7c62-4165-aa41-674d624b5621/volumes"
Jul 01 20:51:20.328857 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:20.328824    2569 generic.go:356] "Generic (PLEG): container finished" podID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerID="467081751b6020389b7c4932e8965d270217ac8087e2d236ba4dcea45ee0d38a" exitCode=0
Jul 01 20:51:20.329256 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:20.328874    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5" event={"ID":"ede1da24-58f9-4942-a1dd-2b2148fc0e72","Type":"ContainerDied","Data":"467081751b6020389b7c4932e8965d270217ac8087e2d236ba4dcea45ee0d38a"}
Jul 01 20:51:28.362067 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:28.362032    2569 generic.go:356] "Generic (PLEG): container finished" podID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerID="bf29c50c082ec41966840d255fcc75e55d7c7c99ac7513c9922864b82494d24e" exitCode=0
Jul 01 20:51:28.362481 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:28.362112    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5" event={"ID":"ede1da24-58f9-4942-a1dd-2b2148fc0e72","Type":"ContainerDied","Data":"bf29c50c082ec41966840d255fcc75e55d7c7c99ac7513c9922864b82494d24e"}
Jul 01 20:51:29.533906 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.533879    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:29.713659 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.713578    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2mh2\" (UniqueName: \"kubernetes.io/projected/ede1da24-58f9-4942-a1dd-2b2148fc0e72-kube-api-access-q2mh2\") pod \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") "
Jul 01 20:51:29.713659 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.713618    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-bundle\") pod \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") "
Jul 01 20:51:29.713659 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.713641    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-util\") pod \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\" (UID: \"ede1da24-58f9-4942-a1dd-2b2148fc0e72\") "
Jul 01 20:51:29.714337 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.714314    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-bundle" (OuterVolumeSpecName: "bundle") pod "ede1da24-58f9-4942-a1dd-2b2148fc0e72" (UID: "ede1da24-58f9-4942-a1dd-2b2148fc0e72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:51:29.715770 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.715736    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede1da24-58f9-4942-a1dd-2b2148fc0e72-kube-api-access-q2mh2" (OuterVolumeSpecName: "kube-api-access-q2mh2") pod "ede1da24-58f9-4942-a1dd-2b2148fc0e72" (UID: "ede1da24-58f9-4942-a1dd-2b2148fc0e72"). InnerVolumeSpecName "kube-api-access-q2mh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:51:29.718768 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.718745    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-util" (OuterVolumeSpecName: "util") pod "ede1da24-58f9-4942-a1dd-2b2148fc0e72" (UID: "ede1da24-58f9-4942-a1dd-2b2148fc0e72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:51:29.814227 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.814199    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2mh2\" (UniqueName: \"kubernetes.io/projected/ede1da24-58f9-4942-a1dd-2b2148fc0e72-kube-api-access-q2mh2\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:29.814227 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.814223    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:29.814227 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:29.814231    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ede1da24-58f9-4942-a1dd-2b2148fc0e72-util\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:51:30.371564 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:30.371533    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5"
Jul 01 20:51:30.371564 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:30.371548    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589jwqt5" event={"ID":"ede1da24-58f9-4942-a1dd-2b2148fc0e72","Type":"ContainerDied","Data":"c53f55c6f538dd2c6f049cfe313047a9879e7df857143854b46a9f25c240fe40"}
Jul 01 20:51:30.371797 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:30.371590    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c53f55c6f538dd2c6f049cfe313047a9879e7df857143854b46a9f25c240fe40"
Jul 01 20:51:34.667984 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:34.667956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:34.821854 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:34.821831    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:51:34.824435 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:34.824418    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:51:34.828738 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:34.828723    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 01 20:51:36.099260 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.099227    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:36.328366 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328331    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"]
Jul 01 20:51:36.328638 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328626    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerName="util"
Jul 01 20:51:36.328679 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328640    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerName="util"
Jul 01 20:51:36.328679 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328655    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ddba8c7-7c62-4165-aa41-674d624b5621" containerName="console"
Jul 01 20:51:36.328679 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328660    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ddba8c7-7c62-4165-aa41-674d624b5621" containerName="console"
Jul 01 20:51:36.328679 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328674    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerName="pull"
Jul 01 20:51:36.328679 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328679    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerName="pull"
Jul 01 20:51:36.328830 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328685    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerName="extract"
Jul 01 20:51:36.328830 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328690    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerName="extract"
Jul 01 20:51:36.328830 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328732    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede1da24-58f9-4942-a1dd-2b2148fc0e72" containerName="extract"
Jul 01 20:51:36.328830 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.328741    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ddba8c7-7c62-4165-aa41-674d624b5621" containerName="console"
Jul 01 20:51:36.330693 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.330676    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.333275 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.333249    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 01 20:51:36.333429 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.333261    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 01 20:51:36.333429 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.333343    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-sqqlw\""
Jul 01 20:51:36.333570 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.333555    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 01 20:51:36.350570 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.350521    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"]
Jul 01 20:51:36.356375 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.356343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/41f67d8a-2d42-4098-819e-d6016ce13c04-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-c7229\" (UID: \"41f67d8a-2d42-4098-819e-d6016ce13c04\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.356480 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.356432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkbxc\" (UniqueName: \"kubernetes.io/projected/41f67d8a-2d42-4098-819e-d6016ce13c04-kube-api-access-qkbxc\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-c7229\" (UID: \"41f67d8a-2d42-4098-819e-d6016ce13c04\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.457433 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.457405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/41f67d8a-2d42-4098-819e-d6016ce13c04-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-c7229\" (UID: \"41f67d8a-2d42-4098-819e-d6016ce13c04\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.457580 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.457460    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkbxc\" (UniqueName: \"kubernetes.io/projected/41f67d8a-2d42-4098-819e-d6016ce13c04-kube-api-access-qkbxc\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-c7229\" (UID: \"41f67d8a-2d42-4098-819e-d6016ce13c04\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.459678 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.459661    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/41f67d8a-2d42-4098-819e-d6016ce13c04-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-c7229\" (UID: \"41f67d8a-2d42-4098-819e-d6016ce13c04\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.466384 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.466356    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkbxc\" (UniqueName: \"kubernetes.io/projected/41f67d8a-2d42-4098-819e-d6016ce13c04-kube-api-access-qkbxc\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-c7229\" (UID: \"41f67d8a-2d42-4098-819e-d6016ce13c04\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.640540 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.640448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:36.773909 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.773883    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"]
Jul 01 20:51:36.777159 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:51:36.777133    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f67d8a_2d42_4098_819e_d6016ce13c04.slice/crio-2500cd68672af8ef619803cfc2cd1dc5f62025339a4abc73449118863ef49229 WatchSource:0}: Error finding container 2500cd68672af8ef619803cfc2cd1dc5f62025339a4abc73449118863ef49229: Status 404 returned error can't find the container with id 2500cd68672af8ef619803cfc2cd1dc5f62025339a4abc73449118863ef49229
Jul 01 20:51:36.778921 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:36.778906    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 20:51:37.399365 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:37.399335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229" event={"ID":"41f67d8a-2d42-4098-819e-d6016ce13c04","Type":"ContainerStarted","Data":"2500cd68672af8ef619803cfc2cd1dc5f62025339a4abc73449118863ef49229"}
Jul 01 20:51:41.126989 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.126959    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:41.411824 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.411750    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:41.415225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.415204    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-bjfxd"]
Jul 01 20:51:41.417820 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.417797    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.421397 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.421372    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 01 20:51:41.422520 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.421543    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 01 20:51:41.422520 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.421548    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-jdj5r\""
Jul 01 20:51:41.423159 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.423122    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229" event={"ID":"41f67d8a-2d42-4098-819e-d6016ce13c04","Type":"ContainerStarted","Data":"e398900af4b2940f08d27abe605250fa990fc3cb51ebc7f2b0a23f4c6365f1a5"}
Jul 01 20:51:41.423275 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.423185    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:51:41.426969 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.426946    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-bjfxd"]
Jul 01 20:51:41.463583 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.463544    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229" podStartSLOduration=1.5972676030000001 podStartE2EDuration="5.463531676s" totalImagesPullingTime="3.866264073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:51:41.462015282 +0000 UTC m=+307.057901585" watchObservedRunningTime="2026-07-01 20:51:41.463531676 +0000 UTC m=+307.059417989"
Jul 01 20:51:41.490831 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.490807    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.490932 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.490846    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqg8c\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-kube-api-access-mqg8c\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.490932 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.490866    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2ab78207-5eef-429b-a271-90dec8f68d24-cabundle0\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.591446 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.591417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqg8c\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-kube-api-access-mqg8c\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.591558 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.591453    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2ab78207-5eef-429b-a271-90dec8f68d24-cabundle0\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.591558 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.591524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.591689 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.591625    2569 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 01 20:51:41.591689 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.591641    2569 secret.go:281] references non-existent secret key: ca.crt
Jul 01 20:51:41.591689 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.591653    2569 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 01 20:51:41.591689 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.591667    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-bjfxd: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 01 20:51:41.591900 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.591740    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates podName:2ab78207-5eef-429b-a271-90dec8f68d24 nodeName:}" failed. No retries permitted until 2026-07-01 20:51:42.091720542 +0000 UTC m=+307.687606837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates") pod "keda-operator-68bff59c-bjfxd" (UID: "2ab78207-5eef-429b-a271-90dec8f68d24") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 01 20:51:41.592120 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.592102    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2ab78207-5eef-429b-a271-90dec8f68d24-cabundle0\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.603576 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.603549    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqg8c\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-kube-api-access-mqg8c\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:41.621201 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.621161    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:41.719599 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.719531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:41.766015 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.765968    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"]
Jul 01 20:51:41.768334 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.768321    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.770775 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.770757    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 01 20:51:41.777617 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.777592    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"]
Jul 01 20:51:41.792592 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.792571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jlc\" (UniqueName: \"kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-kube-api-access-d2jlc\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.792683 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.792603    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/66c708d1-7fab-4785-ab4c-bb3fffb14311-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.792731 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.792683    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-certificates\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.848707 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.848685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:41.893563 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.893540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jlc\" (UniqueName: \"kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-kube-api-access-d2jlc\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.893634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.893566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/66c708d1-7fab-4785-ab4c-bb3fffb14311-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.893634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.893612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-certificates\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.893706 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.893693    2569 secret.go:281] references non-existent secret key: tls.crt
Jul 01 20:51:41.893706 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.893704    2569 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 01 20:51:41.893763 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.893718    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-fztjc: references non-existent secret key: tls.crt
Jul 01 20:51:41.893795 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:41.893767    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-certificates podName:66c708d1-7fab-4785-ab4c-bb3fffb14311 nodeName:}" failed. No retries permitted until 2026-07-01 20:51:42.393755755 +0000 UTC m=+307.989642046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-certificates") pod "keda-metrics-apiserver-559f75f947-fztjc" (UID: "66c708d1-7fab-4785-ab4c-bb3fffb14311") : references non-existent secret key: tls.crt
Jul 01 20:51:41.893989 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.893971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/66c708d1-7fab-4785-ab4c-bb3fffb14311-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:41.902398 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:41.902378    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jlc\" (UniqueName: \"kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-kube-api-access-d2jlc\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:42.094552 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.094524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:42.094704 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:42.094621    2569 secret.go:281] references non-existent secret key: ca.crt
Jul 01 20:51:42.094704 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:42.094642    2569 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 01 20:51:42.094704 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:42.094654    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-bjfxd: references non-existent secret key: ca.crt
Jul 01 20:51:42.094866 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:42.094712    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates podName:2ab78207-5eef-429b-a271-90dec8f68d24 nodeName:}" failed. No retries permitted until 2026-07-01 20:51:43.09469336 +0000 UTC m=+308.690579666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates") pod "keda-operator-68bff59c-bjfxd" (UID: "2ab78207-5eef-429b-a271-90dec8f68d24") : references non-existent secret key: ca.crt
Jul 01 20:51:42.297542 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.297503    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-ssckd"]
Jul 01 20:51:42.300546 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.300529    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:42.301149 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.301125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:42.303212 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.303196    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 01 20:51:42.312269 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.312250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-ssckd"]
Jul 01 20:51:42.397176 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.397108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-certificates\") pod \"keda-admission-5fbd5c4644-ssckd\" (UID: \"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e\") " pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:42.397316 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.397182    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9h4c\" (UniqueName: \"kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-kube-api-access-p9h4c\") pod \"keda-admission-5fbd5c4644-ssckd\" (UID: \"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e\") " pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:42.397316 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.397229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-certificates\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:42.397502 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.397478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:42.399809 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.399787    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/66c708d1-7fab-4785-ab4c-bb3fffb14311-certificates\") pod \"keda-metrics-apiserver-559f75f947-fztjc\" (UID: \"66c708d1-7fab-4785-ab4c-bb3fffb14311\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:42.497652 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.497620    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9h4c\" (UniqueName: \"kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-kube-api-access-p9h4c\") pod \"keda-admission-5fbd5c4644-ssckd\" (UID: \"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e\") " pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:42.497822 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.497764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-certificates\") pod \"keda-admission-5fbd5c4644-ssckd\" (UID: \"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e\") " pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:42.497936 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:42.497918    2569 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 01 20:51:42.498028 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:42.497948    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-ssckd: secret "keda-admission-webhooks-certs" not found
Jul 01 20:51:42.498069 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:51:42.498035    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-certificates podName:b2ae6a92-6b74-4b43-b20f-31df2e98ed7e nodeName:}" failed. No retries permitted until 2026-07-01 20:51:42.998017948 +0000 UTC m=+308.593904249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-certificates") pod "keda-admission-5fbd5c4644-ssckd" (UID: "b2ae6a92-6b74-4b43-b20f-31df2e98ed7e") : secret "keda-admission-webhooks-certs" not found
Jul 01 20:51:42.502843 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.502819    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:42.508953 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.508932    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9h4c\" (UniqueName: \"kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-kube-api-access-p9h4c\") pod \"keda-admission-5fbd5c4644-ssckd\" (UID: \"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e\") " pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:42.679287 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.679202    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:42.751698 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.751669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:42.847986 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.847963    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"]
Jul 01 20:51:42.850989 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:51:42.850961    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c708d1_7fab_4785_ab4c_bb3fffb14311.slice/crio-b2b0512c0af9f0be6f19b7c1763e1f847ff1b18ba6bb581d1b477ec2b5c52f32 WatchSource:0}: Error finding container b2b0512c0af9f0be6f19b7c1763e1f847ff1b18ba6bb581d1b477ec2b5c52f32: Status 404 returned error can't find the container with id b2b0512c0af9f0be6f19b7c1763e1f847ff1b18ba6bb581d1b477ec2b5c52f32
Jul 01 20:51:42.951334 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:42.951263    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:43.003771 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.003745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-certificates\") pod \"keda-admission-5fbd5c4644-ssckd\" (UID: \"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e\") " pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:43.006075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.006055    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b2ae6a92-6b74-4b43-b20f-31df2e98ed7e-certificates\") pod \"keda-admission-5fbd5c4644-ssckd\" (UID: \"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e\") " pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:43.065963 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.065933    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:43.104826 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.104801    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:43.107090 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.107068    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2ab78207-5eef-429b-a271-90dec8f68d24-certificates\") pod \"keda-operator-68bff59c-bjfxd\" (UID: \"2ab78207-5eef-429b-a271-90dec8f68d24\") " pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:43.214159 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.214101    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:43.231987 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.231964    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:43.246564 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.246537    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:51:43.357559 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.357513    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-ssckd"]
Jul 01 20:51:43.361199 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:51:43.361171    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ae6a92_6b74_4b43_b20f_31df2e98ed7e.slice/crio-2d2f4c7a0fb0f8e294eb7bb9a6e4436127548ee0309e9bb35f92b083d26a0ff6 WatchSource:0}: Error finding container 2d2f4c7a0fb0f8e294eb7bb9a6e4436127548ee0309e9bb35f92b083d26a0ff6: Status 404 returned error can't find the container with id 2d2f4c7a0fb0f8e294eb7bb9a6e4436127548ee0309e9bb35f92b083d26a0ff6
Jul 01 20:51:43.387862 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.387840    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-bjfxd"]
Jul 01 20:51:43.388216 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:51:43.388195    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab78207_5eef_429b_a271_90dec8f68d24.slice/crio-3518475a20e23b656868b2fdf7c07e898996b71cd977908fe10c812b17292ba9 WatchSource:0}: Error finding container 3518475a20e23b656868b2fdf7c07e898996b71cd977908fe10c812b17292ba9: Status 404 returned error can't find the container with id 3518475a20e23b656868b2fdf7c07e898996b71cd977908fe10c812b17292ba9
Jul 01 20:51:43.432271 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.432242    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc" event={"ID":"66c708d1-7fab-4785-ab4c-bb3fffb14311","Type":"ContainerStarted","Data":"b2b0512c0af9f0be6f19b7c1763e1f847ff1b18ba6bb581d1b477ec2b5c52f32"}
Jul 01 20:51:43.433270 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.433244    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-ssckd" event={"ID":"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e","Type":"ContainerStarted","Data":"2d2f4c7a0fb0f8e294eb7bb9a6e4436127548ee0309e9bb35f92b083d26a0ff6"}
Jul 01 20:51:43.434235 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:43.434216    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-bjfxd" event={"ID":"2ab78207-5eef-429b-a271-90dec8f68d24","Type":"ContainerStarted","Data":"3518475a20e23b656868b2fdf7c07e898996b71cd977908fe10c812b17292ba9"}
Jul 01 20:51:45.447010 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:45.446911    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-ssckd" event={"ID":"b2ae6a92-6b74-4b43-b20f-31df2e98ed7e","Type":"ContainerStarted","Data":"26689b4cc54cd6e61c1c6de9e8f8ade102551bfcaf8c3686e2e35d4360b72c1d"}
Jul 01 20:51:45.447440 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:45.447040    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:51:45.464481 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:45.464433    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-ssckd" podStartSLOduration=1.687773151 podStartE2EDuration="3.46441461s" totalImagesPullingTime="1.776641459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:51:45.463348818 +0000 UTC m=+311.059235134" watchObservedRunningTime="2026-07-01 20:51:45.46441461 +0000 UTC m=+311.060300925"
Jul 01 20:51:47.458019 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:47.457947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-bjfxd" event={"ID":"2ab78207-5eef-429b-a271-90dec8f68d24","Type":"ContainerStarted","Data":"30315851c0b7b4e18173d8d101d7bcde9bf7de9e414997612e54f897f6dcb04e"}
Jul 01 20:51:47.459678 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:47.459644    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc" event={"ID":"66c708d1-7fab-4785-ab4c-bb3fffb14311","Type":"ContainerStarted","Data":"01edffc1a54ea3f57b4ec5fefb621e0d7d12e02944884cc24da743e1d4289c60"}
Jul 01 20:51:47.459907 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:47.459880    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:47.478068 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:47.478024    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc" podStartSLOduration=1.9421096 podStartE2EDuration="6.477987569s" totalImagesPullingTime="4.535877969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:51:47.476578654 +0000 UTC m=+313.072464966" watchObservedRunningTime="2026-07-01 20:51:47.477987569 +0000 UTC m=+313.073873860"
Jul 01 20:51:49.468521 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:49.468489    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:51:58.469238 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:58.469208    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-fztjc"
Jul 01 20:51:58.488734 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:51:58.488684    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-bjfxd" podStartSLOduration=13.486413504 podStartE2EDuration="17.488668836s" totalImagesPullingTime="4.002255332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:51:48.523834462 +0000 UTC m=+314.119720775" watchObservedRunningTime="2026-07-01 20:51:58.488668836 +0000 UTC m=+324.084555164"
Jul 01 20:52:02.431124 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:02.431093    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-c7229"
Jul 01 20:52:06.455335 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:06.455304    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-ssckd"
Jul 01 20:52:10.476364 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:10.476334    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-bjfxd"
Jul 01 20:52:13.055756 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:13.055718    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:13.152935 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:13.152905    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:29.796075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:29.795986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:29.855013 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:29.854965    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:47.464258 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.464212    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:47.520479 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.520454    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-67485586b-hs5ft"]
Jul 01 20:52:47.522707 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.522692    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.525672 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.525652    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-hf4tz\""
Jul 01 20:52:47.526144 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.526121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 01 20:52:47.526266 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.526251    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 20:52:47.526329 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.526273    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 20:52:47.532863 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.532840    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-67485586b-hs5ft"]
Jul 01 20:52:47.547112 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.547089    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"]
Jul 01 20:52:47.549219 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.549203    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.551491 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.551474    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 01 20:52:47.551602 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.551531    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-vkqq7\""
Jul 01 20:52:47.557442 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.557420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:47.562544 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.562527    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"]
Jul 01 20:52:47.582755 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.582736    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-grkcn"]
Jul 01 20:52:47.584928 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.584913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.587217 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.587200    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 20:52:47.587324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.587260    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-7ntwt\""
Jul 01 20:52:47.594493 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.594475    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-grkcn"]
Jul 01 20:52:47.623155 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.623132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:47.666001 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.665977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g57l\" (UniqueName: \"kubernetes.io/projected/fb0372ae-f06b-41ac-957b-94d4758a4075-kube-api-access-8g57l\") pod \"llmisvc-controller-manager-69fcb569d9-h8mg4\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") " pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.666096 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.666051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/80ad92ba-e39a-4f95-acef-8766e9f82858-data\") pod \"seaweedfs-64568bcd49-grkcn\" (UID: \"80ad92ba-e39a-4f95-acef-8766e9f82858\") " pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.666096 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.666080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ff06046-4bdd-495c-a458-be5653b6314a-cert\") pod \"kserve-controller-manager-67485586b-hs5ft\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") " pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.666187 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.666128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8ftg\" (UniqueName: \"kubernetes.io/projected/80ad92ba-e39a-4f95-acef-8766e9f82858-kube-api-access-q8ftg\") pod \"seaweedfs-64568bcd49-grkcn\" (UID: \"80ad92ba-e39a-4f95-acef-8766e9f82858\") " pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.666187 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.666152    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2fvc\" (UniqueName: \"kubernetes.io/projected/4ff06046-4bdd-495c-a458-be5653b6314a-kube-api-access-j2fvc\") pod \"kserve-controller-manager-67485586b-hs5ft\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") " pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.666271 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.666186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb0372ae-f06b-41ac-957b-94d4758a4075-cert\") pod \"llmisvc-controller-manager-69fcb569d9-h8mg4\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") " pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.676834 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.676813    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:47.766640 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.766589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ff06046-4bdd-495c-a458-be5653b6314a-cert\") pod \"kserve-controller-manager-67485586b-hs5ft\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") " pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.766640 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.766618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8ftg\" (UniqueName: \"kubernetes.io/projected/80ad92ba-e39a-4f95-acef-8766e9f82858-kube-api-access-q8ftg\") pod \"seaweedfs-64568bcd49-grkcn\" (UID: \"80ad92ba-e39a-4f95-acef-8766e9f82858\") " pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.766640 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.766635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2fvc\" (UniqueName: \"kubernetes.io/projected/4ff06046-4bdd-495c-a458-be5653b6314a-kube-api-access-j2fvc\") pod \"kserve-controller-manager-67485586b-hs5ft\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") " pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.766791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.766659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb0372ae-f06b-41ac-957b-94d4758a4075-cert\") pod \"llmisvc-controller-manager-69fcb569d9-h8mg4\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") " pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.766791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.766713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g57l\" (UniqueName: \"kubernetes.io/projected/fb0372ae-f06b-41ac-957b-94d4758a4075-kube-api-access-8g57l\") pod \"llmisvc-controller-manager-69fcb569d9-h8mg4\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") " pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.766791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.766752    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/80ad92ba-e39a-4f95-acef-8766e9f82858-data\") pod \"seaweedfs-64568bcd49-grkcn\" (UID: \"80ad92ba-e39a-4f95-acef-8766e9f82858\") " pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.767122 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.767105    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/80ad92ba-e39a-4f95-acef-8766e9f82858-data\") pod \"seaweedfs-64568bcd49-grkcn\" (UID: \"80ad92ba-e39a-4f95-acef-8766e9f82858\") " pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.768922 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.768904    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb0372ae-f06b-41ac-957b-94d4758a4075-cert\") pod \"llmisvc-controller-manager-69fcb569d9-h8mg4\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") " pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.769031 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.768989    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ff06046-4bdd-495c-a458-be5653b6314a-cert\") pod \"kserve-controller-manager-67485586b-hs5ft\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") " pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.777478 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.777454    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g57l\" (UniqueName: \"kubernetes.io/projected/fb0372ae-f06b-41ac-957b-94d4758a4075-kube-api-access-8g57l\") pod \"llmisvc-controller-manager-69fcb569d9-h8mg4\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") " pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.777806 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.777789    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2fvc\" (UniqueName: \"kubernetes.io/projected/4ff06046-4bdd-495c-a458-be5653b6314a-kube-api-access-j2fvc\") pod \"kserve-controller-manager-67485586b-hs5ft\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") " pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.777850 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.777823    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8ftg\" (UniqueName: \"kubernetes.io/projected/80ad92ba-e39a-4f95-acef-8766e9f82858-kube-api-access-q8ftg\") pod \"seaweedfs-64568bcd49-grkcn\" (UID: \"80ad92ba-e39a-4f95-acef-8766e9f82858\") " pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.783872 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.783853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:47.833976 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.833957    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:47.859243 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.859221    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:47.893318 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.893285    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:47.976743 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:47.976255    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-67485586b-hs5ft"]
Jul 01 20:52:47.977700 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:52:47.977659    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff06046_4bdd_495c_a458_be5653b6314a.slice/crio-537c93767a450a47cf96b4af776faaf149962aaa74600cd6433ce8900d1a17b4 WatchSource:0}: Error finding container 537c93767a450a47cf96b4af776faaf149962aaa74600cd6433ce8900d1a17b4: Status 404 returned error can't find the container with id 537c93767a450a47cf96b4af776faaf149962aaa74600cd6433ce8900d1a17b4
Jul 01 20:52:48.004133 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.004105    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"]
Jul 01 20:52:48.006895 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:52:48.006868    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb0372ae_f06b_41ac_957b_94d4758a4075.slice/crio-215bbd8e7b46458139a114a771b4c6c7af344225f4c3b36092aa268adef9e01f WatchSource:0}: Error finding container 215bbd8e7b46458139a114a771b4c6c7af344225f4c3b36092aa268adef9e01f: Status 404 returned error can't find the container with id 215bbd8e7b46458139a114a771b4c6c7af344225f4c3b36092aa268adef9e01f
Jul 01 20:52:48.041262 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.041241    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-grkcn"]
Jul 01 20:52:48.043254 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:52:48.043229    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ad92ba_e39a_4f95_acef_8766e9f82858.slice/crio-503dd4f8ea795477e62b2ee947d34b08e14c4626d83d4d0d00fea05678debab4 WatchSource:0}: Error finding container 503dd4f8ea795477e62b2ee947d34b08e14c4626d83d4d0d00fea05678debab4: Status 404 returned error can't find the container with id 503dd4f8ea795477e62b2ee947d34b08e14c4626d83d4d0d00fea05678debab4
Jul 01 20:52:48.321087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.321009    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:48.419621 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.419595    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:48.476442 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.476412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:52:48.724154 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.724118    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-grkcn" event={"ID":"80ad92ba-e39a-4f95-acef-8766e9f82858","Type":"ContainerStarted","Data":"503dd4f8ea795477e62b2ee947d34b08e14c4626d83d4d0d00fea05678debab4"}
Jul 01 20:52:48.727069 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.727041    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4" event={"ID":"fb0372ae-f06b-41ac-957b-94d4758a4075","Type":"ContainerStarted","Data":"215bbd8e7b46458139a114a771b4c6c7af344225f4c3b36092aa268adef9e01f"}
Jul 01 20:52:48.729368 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:48.729344    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-67485586b-hs5ft" event={"ID":"4ff06046-4bdd-495c-a458-be5653b6314a","Type":"ContainerStarted","Data":"537c93767a450a47cf96b4af776faaf149962aaa74600cd6433ce8900d1a17b4"}
Jul 01 20:52:52.755278 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.755021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-67485586b-hs5ft" event={"ID":"4ff06046-4bdd-495c-a458-be5653b6314a","Type":"ContainerStarted","Data":"04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a"}
Jul 01 20:52:52.755278 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.755176    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:52:52.756793 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.756768    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:52:52.758022 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.757985    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4" event={"ID":"fb0372ae-f06b-41ac-957b-94d4758a4075","Type":"ContainerStarted","Data":"d6f7a2c3a18dfc9a435abf17d165ef26ba549ec84b0959c34d440aef768487f1"}
Jul 01 20:52:52.758143 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.758130    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:52:52.779146 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.779099    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-67485586b-hs5ft" podStartSLOduration=1.9964722190000002 podStartE2EDuration="5.779087427s" totalImagesPullingTime="3.782615208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:52:52.777465857 +0000 UTC m=+378.373352171" watchObservedRunningTime="2026-07-01 20:52:52.779087427 +0000 UTC m=+378.374973739"
Jul 01 20:52:52.797078 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.797034    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-grkcn" podStartSLOduration=1.212571459 podStartE2EDuration="5.796985546s" totalImagesPullingTime="4.584414087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:52:52.796085366 +0000 UTC m=+378.391971680" watchObservedRunningTime="2026-07-01 20:52:52.796985546 +0000 UTC m=+378.392871859"
Jul 01 20:52:52.815425 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:52.815350    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4" podStartSLOduration=1.23952775 podStartE2EDuration="5.815331982s" totalImagesPullingTime="4.575804232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:52:52.814464025 +0000 UTC m=+378.410350338" watchObservedRunningTime="2026-07-01 20:52:52.815331982 +0000 UTC m=+378.411218296"
Jul 01 20:52:53.764314 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:53.764275    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-grkcn" event={"ID":"80ad92ba-e39a-4f95-acef-8766e9f82858","Type":"ContainerStarted","Data":"a1b5acdd71b0de943c7a48356c389a7ff26549f202150b2e586731046992a0fa"}
Jul 01 20:52:59.769908 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:52:59.769875    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-grkcn"
Jul 01 20:53:23.767343 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:23.767304    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 20:53:23.770306 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:23.770285    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:53:24.974512 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:24.974478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:25.079496 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.079467    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:25.235324 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.235254    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"]
Jul 01 20:53:25.242378 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.242358    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.245897 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.245872    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 01 20:53:25.246108 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.246088    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 01 20:53:25.246177 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.246166    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-282rv\""
Jul 01 20:53:25.249808 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.249548    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"]
Jul 01 20:53:25.343295 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.343270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5s7l\" (UniqueName: \"kubernetes.io/projected/c799e76f-1ad1-4027-9fd5-e70be560a7d2-kube-api-access-m5s7l\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.343404 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.343299    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.343404 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.343324    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.444588 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.444563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.444687 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.444618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5s7l\" (UniqueName: \"kubernetes.io/projected/c799e76f-1ad1-4027-9fd5-e70be560a7d2-kube-api-access-m5s7l\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.444687 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.444638    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.444910 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.444890    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.444987 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.444972    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.452782 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.452760    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5s7l\" (UniqueName: \"kubernetes.io/projected/c799e76f-1ad1-4027-9fd5-e70be560a7d2-kube-api-access-m5s7l\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.552233 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.552182    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:25.678458 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.678430    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"]
Jul 01 20:53:25.680796 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:53:25.680770    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc799e76f_1ad1_4027_9fd5_e70be560a7d2.slice/crio-cb8c673a18ad974a9ac0f7d76b2616cf30c17a7f51bb1fe58c5bcf0088cc61d0 WatchSource:0}: Error finding container cb8c673a18ad974a9ac0f7d76b2616cf30c17a7f51bb1fe58c5bcf0088cc61d0: Status 404 returned error can't find the container with id cb8c673a18ad974a9ac0f7d76b2616cf30c17a7f51bb1fe58c5bcf0088cc61d0
Jul 01 20:53:25.909031 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.908980    2569 generic.go:356] "Generic (PLEG): container finished" podID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerID="7c26215281d3d99ee1276971b3ec9c508c6d9f138c1aa0f3b7a8eab4949b3dfe" exitCode=0
Jul 01 20:53:25.909145 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.909068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp" event={"ID":"c799e76f-1ad1-4027-9fd5-e70be560a7d2","Type":"ContainerDied","Data":"7c26215281d3d99ee1276971b3ec9c508c6d9f138c1aa0f3b7a8eab4949b3dfe"}
Jul 01 20:53:25.909145 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:25.909125    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp" event={"ID":"c799e76f-1ad1-4027-9fd5-e70be560a7d2","Type":"ContainerStarted","Data":"cb8c673a18ad974a9ac0f7d76b2616cf30c17a7f51bb1fe58c5bcf0088cc61d0"}
Jul 01 20:53:28.038599 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:28.038561    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:28.927911 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:28.927876    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp" event={"ID":"c799e76f-1ad1-4027-9fd5-e70be560a7d2","Type":"ContainerStarted","Data":"e5b8c4991f62670d2cc7f0bd760dc445586d73722e9530ef2c210bfc879e30e7"}
Jul 01 20:53:29.935347 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:29.935304    2569 generic.go:356] "Generic (PLEG): container finished" podID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerID="e5b8c4991f62670d2cc7f0bd760dc445586d73722e9530ef2c210bfc879e30e7" exitCode=0
Jul 01 20:53:29.935852 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:29.935388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp" event={"ID":"c799e76f-1ad1-4027-9fd5-e70be560a7d2","Type":"ContainerDied","Data":"e5b8c4991f62670d2cc7f0bd760dc445586d73722e9530ef2c210bfc879e30e7"}
Jul 01 20:53:30.943563 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:30.943531    2569 generic.go:356] "Generic (PLEG): container finished" podID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerID="348ec5e3e36d1113ae0c0790f3c6a7d076f14dbf839f441e2ec9fc608b8229ca" exitCode=0
Jul 01 20:53:30.943951 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:30.943619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp" event={"ID":"c799e76f-1ad1-4027-9fd5-e70be560a7d2","Type":"ContainerDied","Data":"348ec5e3e36d1113ae0c0790f3c6a7d076f14dbf839f441e2ec9fc608b8229ca"}
Jul 01 20:53:32.080422 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.080400    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:32.088231 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.088209    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-util\") pod \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") "
Jul 01 20:53:32.088349 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.088249    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-bundle\") pod \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") "
Jul 01 20:53:32.088349 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.088281    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5s7l\" (UniqueName: \"kubernetes.io/projected/c799e76f-1ad1-4027-9fd5-e70be560a7d2-kube-api-access-m5s7l\") pod \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\" (UID: \"c799e76f-1ad1-4027-9fd5-e70be560a7d2\") "
Jul 01 20:53:32.088891 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.088862    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-bundle" (OuterVolumeSpecName: "bundle") pod "c799e76f-1ad1-4027-9fd5-e70be560a7d2" (UID: "c799e76f-1ad1-4027-9fd5-e70be560a7d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:53:32.090251 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.090228    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c799e76f-1ad1-4027-9fd5-e70be560a7d2-kube-api-access-m5s7l" (OuterVolumeSpecName: "kube-api-access-m5s7l") pod "c799e76f-1ad1-4027-9fd5-e70be560a7d2" (UID: "c799e76f-1ad1-4027-9fd5-e70be560a7d2"). InnerVolumeSpecName "kube-api-access-m5s7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:53:32.094864 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.094839    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-util" (OuterVolumeSpecName: "util") pod "c799e76f-1ad1-4027-9fd5-e70be560a7d2" (UID: "c799e76f-1ad1-4027-9fd5-e70be560a7d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:53:32.189098 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.189074    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:53:32.189098 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.189096    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5s7l\" (UniqueName: \"kubernetes.io/projected/c799e76f-1ad1-4027-9fd5-e70be560a7d2-kube-api-access-m5s7l\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:53:32.189217 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.189107    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c799e76f-1ad1-4027-9fd5-e70be560a7d2-util\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:53:32.954876 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.954849    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp"
Jul 01 20:53:32.955059 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.954845    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2djp" event={"ID":"c799e76f-1ad1-4027-9fd5-e70be560a7d2","Type":"ContainerDied","Data":"cb8c673a18ad974a9ac0f7d76b2616cf30c17a7f51bb1fe58c5bcf0088cc61d0"}
Jul 01 20:53:32.955059 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:32.954971    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb8c673a18ad974a9ac0f7d76b2616cf30c17a7f51bb1fe58c5bcf0088cc61d0"
Jul 01 20:53:36.119206 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:36.119173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:36.847648 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:36.847614    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:39.926901 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:39.926862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:40.017086 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:40.017059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:40.797652 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:40.797620    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:42.133913 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:42.133882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:42.234375 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:42.234340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:44.730120 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:44.730086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:44.831469 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:44.831441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:45.539491 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:45.539463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:46.036541 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:46.036502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:46.477667 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:46.477632    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:46.753804 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:46.753697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:46.853643 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:46.853618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:47.349509 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.349477    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"]
Jul 01 20:53:47.349956 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.349909    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerName="pull"
Jul 01 20:53:47.349956 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.349925    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerName="pull"
Jul 01 20:53:47.349956 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.349941    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerName="extract"
Jul 01 20:53:47.349956 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.349948    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerName="extract"
Jul 01 20:53:47.350116 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.349974    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerName="util"
Jul 01 20:53:47.350116 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.349980    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerName="util"
Jul 01 20:53:47.350116 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.350057    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c799e76f-1ad1-4027-9fd5-e70be560a7d2" containerName="extract"
Jul 01 20:53:47.354478 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.354462    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.357067 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.357046    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-282rv\""
Jul 01 20:53:47.357162 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.357058    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 01 20:53:47.357620 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.357607    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 01 20:53:47.361210 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.361187    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"]
Jul 01 20:53:47.392540 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.392521    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.392630 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.392552    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcvr8\" (UniqueName: \"kubernetes.io/projected/092a4e84-a5f1-4a79-be38-f2e979418dfb-kube-api-access-lcvr8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.392630 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.392583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.493083 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.493061    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcvr8\" (UniqueName: \"kubernetes.io/projected/092a4e84-a5f1-4a79-be38-f2e979418dfb-kube-api-access-lcvr8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.493155 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.493104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.493155 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.493146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.493455 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.493435    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.493498 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.493443    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.502253 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.502222    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcvr8\" (UniqueName: \"kubernetes.io/projected/092a4e84-a5f1-4a79-be38-f2e979418dfb-kube-api-access-lcvr8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.665151 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.665080    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:47.797888 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:47.797853    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"]
Jul 01 20:53:47.799957 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:53:47.799931    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092a4e84_a5f1_4a79_be38_f2e979418dfb.slice/crio-26f0f90a0ea61f74c6224807ef41a3bca48f812cb2e3afeba866fc0bb9bd4159 WatchSource:0}: Error finding container 26f0f90a0ea61f74c6224807ef41a3bca48f812cb2e3afeba866fc0bb9bd4159: Status 404 returned error can't find the container with id 26f0f90a0ea61f74c6224807ef41a3bca48f812cb2e3afeba866fc0bb9bd4159
Jul 01 20:53:48.021028 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:48.020947    2569 generic.go:356] "Generic (PLEG): container finished" podID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerID="f3898cc7f2475dd2c31316d08dee92c717ec155660f55150f9f09defeff1de94" exitCode=0
Jul 01 20:53:48.021133 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:48.021032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f" event={"ID":"092a4e84-a5f1-4a79-be38-f2e979418dfb","Type":"ContainerDied","Data":"f3898cc7f2475dd2c31316d08dee92c717ec155660f55150f9f09defeff1de94"}
Jul 01 20:53:48.021133 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:48.021075    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f" event={"ID":"092a4e84-a5f1-4a79-be38-f2e979418dfb","Type":"ContainerStarted","Data":"26f0f90a0ea61f74c6224807ef41a3bca48f812cb2e3afeba866fc0bb9bd4159"}
Jul 01 20:53:51.034580 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:51.034544    2569 generic.go:356] "Generic (PLEG): container finished" podID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerID="183f58adaa1cfe20a5925d5aae4f8fe309c8e2c07f31fa597001adbd2ce0edf2" exitCode=0
Jul 01 20:53:51.034961 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:51.034600    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f" event={"ID":"092a4e84-a5f1-4a79-be38-f2e979418dfb","Type":"ContainerDied","Data":"183f58adaa1cfe20a5925d5aae4f8fe309c8e2c07f31fa597001adbd2ce0edf2"}
Jul 01 20:53:51.230598 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:51.230574    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:51.331205 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:51.331156    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:52.042614 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:52.042581    2569 generic.go:356] "Generic (PLEG): container finished" podID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerID="9cec8a3c7b402f501e936e8e8508cab46ec3e8b0fe85f0384a76574d8b9e1444" exitCode=0
Jul 01 20:53:52.043037 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:52.042658    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f" event={"ID":"092a4e84-a5f1-4a79-be38-f2e979418dfb","Type":"ContainerDied","Data":"9cec8a3c7b402f501e936e8e8508cab46ec3e8b0fe85f0384a76574d8b9e1444"}
Jul 01 20:53:53.179139 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.179113    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:53.237290 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.237268    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-util\") pod \"092a4e84-a5f1-4a79-be38-f2e979418dfb\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") "
Jul 01 20:53:53.237413 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.237311    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcvr8\" (UniqueName: \"kubernetes.io/projected/092a4e84-a5f1-4a79-be38-f2e979418dfb-kube-api-access-lcvr8\") pod \"092a4e84-a5f1-4a79-be38-f2e979418dfb\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") "
Jul 01 20:53:53.237413 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.237342    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-bundle\") pod \"092a4e84-a5f1-4a79-be38-f2e979418dfb\" (UID: \"092a4e84-a5f1-4a79-be38-f2e979418dfb\") "
Jul 01 20:53:53.237772 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.237742    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-bundle" (OuterVolumeSpecName: "bundle") pod "092a4e84-a5f1-4a79-be38-f2e979418dfb" (UID: "092a4e84-a5f1-4a79-be38-f2e979418dfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:53:53.239308 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.239278    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092a4e84-a5f1-4a79-be38-f2e979418dfb-kube-api-access-lcvr8" (OuterVolumeSpecName: "kube-api-access-lcvr8") pod "092a4e84-a5f1-4a79-be38-f2e979418dfb" (UID: "092a4e84-a5f1-4a79-be38-f2e979418dfb"). InnerVolumeSpecName "kube-api-access-lcvr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:53:53.314137 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.314086    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-util" (OuterVolumeSpecName: "util") pod "092a4e84-a5f1-4a79-be38-f2e979418dfb" (UID: "092a4e84-a5f1-4a79-be38-f2e979418dfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:53:53.337830 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.337807    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-util\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:53:53.337830 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.337829    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcvr8\" (UniqueName: \"kubernetes.io/projected/092a4e84-a5f1-4a79-be38-f2e979418dfb-kube-api-access-lcvr8\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:53:53.337938 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:53.337840    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/092a4e84-a5f1-4a79-be38-f2e979418dfb-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:53:54.038716 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:54.038673    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:54.054416 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:54.054387    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f" event={"ID":"092a4e84-a5f1-4a79-be38-f2e979418dfb","Type":"ContainerDied","Data":"26f0f90a0ea61f74c6224807ef41a3bca48f812cb2e3afeba866fc0bb9bd4159"}
Jul 01 20:53:54.054416 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:54.054416    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fktc5f"
Jul 01 20:53:54.054577 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:54.054434    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26f0f90a0ea61f74c6224807ef41a3bca48f812cb2e3afeba866fc0bb9bd4159"
Jul 01 20:53:58.340640 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:58.340567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:53:58.437100 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:53:58.437071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:02.977934 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:02.977898    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:10.281635 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:10.281585    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:13.230322 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230287    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8dbc4859-4xgml"]
Jul 01 20:54:13.230669 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230612    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerName="pull"
Jul 01 20:54:13.230669 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230623    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerName="pull"
Jul 01 20:54:13.230669 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230639    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerName="util"
Jul 01 20:54:13.230669 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230645    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerName="util"
Jul 01 20:54:13.230669 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230659    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerName="extract"
Jul 01 20:54:13.230669 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230668    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerName="extract"
Jul 01 20:54:13.230846 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.230724    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="092a4e84-a5f1-4a79-be38-f2e979418dfb" containerName="extract"
Jul 01 20:54:13.238743 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.238719    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.247675 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.247650    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8dbc4859-4xgml"]
Jul 01 20:54:13.280672 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.280647    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-trusted-ca-bundle\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.280808 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.280691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-service-ca\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.280808 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.280723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrt7\" (UniqueName: \"kubernetes.io/projected/504138a7-6fc0-441e-91f7-e21e143cff8d-kube-api-access-7vrt7\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.280808 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.280766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/504138a7-6fc0-441e-91f7-e21e143cff8d-console-oauth-config\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.280808 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.280791    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-oauth-serving-cert\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.280948 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.280841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-console-config\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.280948 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.280866    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/504138a7-6fc0-441e-91f7-e21e143cff8d-console-serving-cert\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.290309 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.290290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:13.348389 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.348361    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:13.382044 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrt7\" (UniqueName: \"kubernetes.io/projected/504138a7-6fc0-441e-91f7-e21e143cff8d-kube-api-access-7vrt7\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382148 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/504138a7-6fc0-441e-91f7-e21e143cff8d-console-oauth-config\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382148 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-oauth-serving-cert\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382148 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382088    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-console-config\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382148 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382132    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/504138a7-6fc0-441e-91f7-e21e143cff8d-console-serving-cert\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382340 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-trusted-ca-bundle\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382340 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382257    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-service-ca\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382871 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382823    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-oauth-serving-cert\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382871 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382839    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-service-ca\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.382871 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.382823    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-console-config\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.383146 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.383125    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/504138a7-6fc0-441e-91f7-e21e143cff8d-trusted-ca-bundle\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.384536 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.384514    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/504138a7-6fc0-441e-91f7-e21e143cff8d-console-oauth-config\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.384661 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.384645    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/504138a7-6fc0-441e-91f7-e21e143cff8d-console-serving-cert\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.390864 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.390845    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrt7\" (UniqueName: \"kubernetes.io/projected/504138a7-6fc0-441e-91f7-e21e143cff8d-kube-api-access-7vrt7\") pod \"console-8dbc4859-4xgml\" (UID: \"504138a7-6fc0-441e-91f7-e21e143cff8d\") " pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.433263 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.433236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:13.509108 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.509053    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:13.548639 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.548618    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:13.684478 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:13.684455    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8dbc4859-4xgml"]
Jul 01 20:54:13.687097 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:13.687067    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504138a7_6fc0_441e_91f7_e21e143cff8d.slice/crio-ba321f28e4e5d53cbcb283d033bc6b3dbfbd6534dd25a9812c0831bc26c3fee0 WatchSource:0}: Error finding container ba321f28e4e5d53cbcb283d033bc6b3dbfbd6534dd25a9812c0831bc26c3fee0: Status 404 returned error can't find the container with id ba321f28e4e5d53cbcb283d033bc6b3dbfbd6534dd25a9812c0831bc26c3fee0
Jul 01 20:54:14.011546 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:14.011517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:14.111595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:14.111568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:14.146338 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:14.146308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8dbc4859-4xgml" event={"ID":"504138a7-6fc0-441e-91f7-e21e143cff8d","Type":"ContainerStarted","Data":"72bfd0486e7f5501e8ad1911c40faee63858ff12f3771d66182a8c9f0402204d"}
Jul 01 20:54:14.146466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:14.146356    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8dbc4859-4xgml" event={"ID":"504138a7-6fc0-441e-91f7-e21e143cff8d","Type":"ContainerStarted","Data":"ba321f28e4e5d53cbcb283d033bc6b3dbfbd6534dd25a9812c0831bc26c3fee0"}
Jul 01 20:54:14.168657 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:14.168613    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8dbc4859-4xgml" podStartSLOduration=1.168596416 podStartE2EDuration="1.168596416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:54:14.167386163 +0000 UTC m=+459.763272489" watchObservedRunningTime="2026-07-01 20:54:14.168596416 +0000 UTC m=+459.764482730"
Jul 01 20:54:15.112714 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.112683    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"]
Jul 01 20:54:15.116103 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.116088    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.120858 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.120839    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 01 20:54:15.120981 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.120871    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 01 20:54:15.121062 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.121047    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 01 20:54:15.121110 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.121077    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 01 20:54:15.121169 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.121094    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jhhhs\""
Jul 01 20:54:15.121169 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.121127    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 01 20:54:15.121272 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.121166    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 01 20:54:15.131277 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.131258    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"]
Jul 01 20:54:15.153649 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.153623    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:15.194676 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.194653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.194768 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.194678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.194768 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.194702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.194768 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.194721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.194768 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.194758    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.194924 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.194797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvmmz\" (UniqueName: \"kubernetes.io/projected/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-kube-api-access-zvmmz\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.194924 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.194833    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.235096 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.235076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:15.295632 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.295602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.295772 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.295747    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.295974 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.295948    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.296104 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.296023    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.296104 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.296061    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.296223 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.296107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.296223 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.296180    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvmmz\" (UniqueName: \"kubernetes.io/projected/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-kube-api-access-zvmmz\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.296684 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.296656    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.298282 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.298254    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.298396 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.298375    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.298529 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.298512    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.298891 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.298876    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.305220 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.305197    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.305378 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.305361    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvmmz\" (UniqueName: \"kubernetes.io/projected/6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8-kube-api-access-zvmmz\") pod \"istiod-openshift-gateway-94bb8fbfd-kqnw7\" (UID: \"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.426421 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.426355    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:15.585689 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:15.585590    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"]
Jul 01 20:54:15.588362 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:15.588330    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b69f793_1b87_44f2_9ee9_b9b4b1f49eb8.slice/crio-1572cb44350c2122c44352f25f8ff80f1e4d6f1a4da230ae7a19118cb43b3bac WatchSource:0}: Error finding container 1572cb44350c2122c44352f25f8ff80f1e4d6f1a4da230ae7a19118cb43b3bac: Status 404 returned error can't find the container with id 1572cb44350c2122c44352f25f8ff80f1e4d6f1a4da230ae7a19118cb43b3bac
Jul 01 20:54:16.156763 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:16.156732    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7" event={"ID":"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8","Type":"ContainerStarted","Data":"1572cb44350c2122c44352f25f8ff80f1e4d6f1a4da230ae7a19118cb43b3bac"}
Jul 01 20:54:16.271139 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:16.271109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:18.606055 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:18.606019    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:54:18.606309 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:18.606088    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:54:19.173152 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:19.173119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7" event={"ID":"6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8","Type":"ContainerStarted","Data":"ac801fe211273bef730d4656eba9bcf0485351bd1d2081399e9f9fe3d7d5cdd2"}
Jul 01 20:54:19.173315 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:19.173173    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:19.176221 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:19.174885    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-kqnw7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 01 20:54:19.176221 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:19.174945    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7" podUID="6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 20:54:19.193113 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:19.193071    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7" podStartSLOduration=1.177690555 podStartE2EDuration="4.193058205s" totalImagesPullingTime="3.01536765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:54:19.191323047 +0000 UTC m=+464.787209361" watchObservedRunningTime="2026-07-01 20:54:19.193058205 +0000 UTC m=+464.788944517"
Jul 01 20:54:19.432689 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:19.432603    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:19.533930 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:19.533904    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:20.178550 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:20.178518    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7"
Jul 01 20:54:21.448256 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:21.448208    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:21.862740 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:21.862695    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:23.549152 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:23.549121    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:23.549531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:23.549198    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:23.553680 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:23.553660    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:24.199361 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:24.199333    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8dbc4859-4xgml"
Jul 01 20:54:24.246018 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:24.245965    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6dfc47bf-cmfrl"]
Jul 01 20:54:24.363702 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:24.363674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:24.463830 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:24.463767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:24.531406 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:24.531380    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:24.594476 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:24.594454    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:28.917015 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:28.916963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:29.063383 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:29.063354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:29.979067 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:29.979032    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:30.088241 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:30.088215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:31.329222 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.329192    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"]
Jul 01 20:54:31.332905 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.332889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.336247 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.336224    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-282rv\""
Jul 01 20:54:31.336518 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.336503    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 01 20:54:31.337054 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.337035    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 01 20:54:31.353912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.353888    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"]
Jul 01 20:54:31.426250 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.426215    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hzrv\" (UniqueName: \"kubernetes.io/projected/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-kube-api-access-6hzrv\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.426359 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.426261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.426359 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.426340    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.484154 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.484130    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"]
Jul 01 20:54:31.487631 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.487616    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.496783 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.496761    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"]
Jul 01 20:54:31.527595 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.527572    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.527688 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.527611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hzrv\" (UniqueName: \"kubernetes.io/projected/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-kube-api-access-6hzrv\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.527688 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.527643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.527928 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.527910    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.527969 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.527956    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.539123 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.539094    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hzrv\" (UniqueName: \"kubernetes.io/projected/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-kube-api-access-6hzrv\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.540536 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.540517    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"]
Jul 01 20:54:31.543893 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.543880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.555166 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.555136    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"]
Jul 01 20:54:31.628478 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.628453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.628581 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.628492    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.628581 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.628510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.628581 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.628548    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lplx\" (UniqueName: \"kubernetes.io/projected/6654c881-3b3b-427b-b9d0-15f72fee0e57-kube-api-access-9lplx\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.628700 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.628628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.628700 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.628648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scl69\" (UniqueName: \"kubernetes.io/projected/d58f1cf7-6ac3-4011-93e8-650cf605f239-kube-api-access-scl69\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.632921 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.632901    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"]
Jul 01 20:54:31.636380 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.636365    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.642300 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.642284    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:31.646035 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.646012    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"]
Jul 01 20:54:31.729533 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729507    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.729664 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scl69\" (UniqueName: \"kubernetes.io/projected/d58f1cf7-6ac3-4011-93e8-650cf605f239-kube-api-access-scl69\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.729664 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.729664 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.729825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.729825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.729825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729772    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.729825 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lplx\" (UniqueName: \"kubernetes.io/projected/6654c881-3b3b-427b-b9d0-15f72fee0e57-kube-api-access-9lplx\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.730043 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnl44\" (UniqueName: \"kubernetes.io/projected/9c49303d-7d82-45c6-a2f9-6dc574d71705-kube-api-access-jnl44\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.730043 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.729921    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.730156 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.730093    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.730200 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.730187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.730249 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.730213    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.738568 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.738546    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lplx\" (UniqueName: \"kubernetes.io/projected/6654c881-3b3b-427b-b9d0-15f72fee0e57-kube-api-access-9lplx\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.738885 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.738860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scl69\" (UniqueName: \"kubernetes.io/projected/d58f1cf7-6ac3-4011-93e8-650cf605f239-kube-api-access-scl69\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.770555 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.770532    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"]
Jul 01 20:54:31.773125 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:31.773099    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bb51b8_44af_4f68_a1a4_a3e5e5ed012b.slice/crio-df361ead714870fdc8cf2535673dd409a00706c74d416c2bcf3842e10b2c5791 WatchSource:0}: Error finding container df361ead714870fdc8cf2535673dd409a00706c74d416c2bcf3842e10b2c5791: Status 404 returned error can't find the container with id df361ead714870fdc8cf2535673dd409a00706c74d416c2bcf3842e10b2c5791
Jul 01 20:54:31.796277 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.796257    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:31.830353 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.830324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnl44\" (UniqueName: \"kubernetes.io/projected/9c49303d-7d82-45c6-a2f9-6dc574d71705-kube-api-access-jnl44\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.830438 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.830417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.830478 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.830467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.830774 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.830754    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.830826 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.830810    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.838181 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.838160    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnl44\" (UniqueName: \"kubernetes.io/projected/9c49303d-7d82-45c6-a2f9-6dc574d71705-kube-api-access-jnl44\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.854093 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.854065    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:31.937066 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.937026    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"]
Jul 01 20:54:31.941846 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:31.941819    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6654c881_3b3b_427b_b9d0_15f72fee0e57.slice/crio-a456686c581b8cdf639415c57a6469053aed2e35a7b591e7197e741a0825c84e WatchSource:0}: Error finding container a456686c581b8cdf639415c57a6469053aed2e35a7b591e7197e741a0825c84e: Status 404 returned error can't find the container with id a456686c581b8cdf639415c57a6469053aed2e35a7b591e7197e741a0825c84e
Jul 01 20:54:31.947349 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.947321    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:31.996744 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:31.996716    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"]
Jul 01 20:54:31.998721 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:31.998694    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58f1cf7_6ac3_4011_93e8_650cf605f239.slice/crio-40e66116b1e1b53117d59b305d03eee1862a386bafc9c82893992665e9bef33d WatchSource:0}: Error finding container 40e66116b1e1b53117d59b305d03eee1862a386bafc9c82893992665e9bef33d: Status 404 returned error can't find the container with id 40e66116b1e1b53117d59b305d03eee1862a386bafc9c82893992665e9bef33d
Jul 01 20:54:32.095897 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.095868    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"]
Jul 01 20:54:32.103880 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:32.103851    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c49303d_7d82_45c6_a2f9_6dc574d71705.slice/crio-e0e57b31a37b47ecf824dc958274db0241675986f0e704f698ea2824e673274b WatchSource:0}: Error finding container e0e57b31a37b47ecf824dc958274db0241675986f0e704f698ea2824e673274b: Status 404 returned error can't find the container with id e0e57b31a37b47ecf824dc958274db0241675986f0e704f698ea2824e673274b
Jul 01 20:54:32.240125 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.240089    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w" event={"ID":"9c49303d-7d82-45c6-a2f9-6dc574d71705","Type":"ContainerStarted","Data":"4991b87756b63ed761ee10e8392b4e5874e922a681750ad6ec04136b4843c22e"}
Jul 01 20:54:32.240347 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.240146    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w" event={"ID":"9c49303d-7d82-45c6-a2f9-6dc574d71705","Type":"ContainerStarted","Data":"e0e57b31a37b47ecf824dc958274db0241675986f0e704f698ea2824e673274b"}
Jul 01 20:54:32.241754 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.241726    2569 generic.go:356] "Generic (PLEG): container finished" podID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerID="d3b7a50949d9a01f3b2807af80fd8552e47b5f590a2c88c229c077d74f9b3260" exitCode=0
Jul 01 20:54:32.241883 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.241791    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb" event={"ID":"d58f1cf7-6ac3-4011-93e8-650cf605f239","Type":"ContainerDied","Data":"d3b7a50949d9a01f3b2807af80fd8552e47b5f590a2c88c229c077d74f9b3260"}
Jul 01 20:54:32.241883 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.241831    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb" event={"ID":"d58f1cf7-6ac3-4011-93e8-650cf605f239","Type":"ContainerStarted","Data":"40e66116b1e1b53117d59b305d03eee1862a386bafc9c82893992665e9bef33d"}
Jul 01 20:54:32.243417 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.243392    2569 generic.go:356] "Generic (PLEG): container finished" podID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerID="15a0e53aae52e94d92e13b71cb555f7bf1304536a6beb0e5ada99833783602ee" exitCode=0
Jul 01 20:54:32.243515 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.243490    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b" event={"ID":"6654c881-3b3b-427b-b9d0-15f72fee0e57","Type":"ContainerDied","Data":"15a0e53aae52e94d92e13b71cb555f7bf1304536a6beb0e5ada99833783602ee"}
Jul 01 20:54:32.243576 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.243526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b" event={"ID":"6654c881-3b3b-427b-b9d0-15f72fee0e57","Type":"ContainerStarted","Data":"a456686c581b8cdf639415c57a6469053aed2e35a7b591e7197e741a0825c84e"}
Jul 01 20:54:32.245513 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.245495    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerID="293c9522acbbe1de3a29764fd471ba5937729c73a0a4f42fdca297e433a887e4" exitCode=0
Jul 01 20:54:32.245591 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.245533    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7" event={"ID":"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b","Type":"ContainerDied","Data":"293c9522acbbe1de3a29764fd471ba5937729c73a0a4f42fdca297e433a887e4"}
Jul 01 20:54:32.245591 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:32.245575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7" event={"ID":"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b","Type":"ContainerStarted","Data":"df361ead714870fdc8cf2535673dd409a00706c74d416c2bcf3842e10b2c5791"}
Jul 01 20:54:33.252055 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:33.252026    2569 generic.go:356] "Generic (PLEG): container finished" podID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerID="4991b87756b63ed761ee10e8392b4e5874e922a681750ad6ec04136b4843c22e" exitCode=0
Jul 01 20:54:33.252402 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:33.252092    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w" event={"ID":"9c49303d-7d82-45c6-a2f9-6dc574d71705","Type":"ContainerDied","Data":"4991b87756b63ed761ee10e8392b4e5874e922a681750ad6ec04136b4843c22e"}
Jul 01 20:54:34.259110 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:34.259076    2569 generic.go:356] "Generic (PLEG): container finished" podID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerID="029209bee3b7dbe503dff6fab9a5a3d8a5103960df9e1591265a30bd976c935d" exitCode=0
Jul 01 20:54:34.259492 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:34.259152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb" event={"ID":"d58f1cf7-6ac3-4011-93e8-650cf605f239","Type":"ContainerDied","Data":"029209bee3b7dbe503dff6fab9a5a3d8a5103960df9e1591265a30bd976c935d"}
Jul 01 20:54:34.261179 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:34.261155    2569 generic.go:356] "Generic (PLEG): container finished" podID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerID="9f2c5c3052c892ca05bd893f98987aaffc3a961ee2c7195d4f0b3bc36ed8ebf6" exitCode=0
Jul 01 20:54:34.261274 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:34.261255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b" event={"ID":"6654c881-3b3b-427b-b9d0-15f72fee0e57","Type":"ContainerDied","Data":"9f2c5c3052c892ca05bd893f98987aaffc3a961ee2c7195d4f0b3bc36ed8ebf6"}
Jul 01 20:54:34.263245 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:34.263222    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerID="404c9e38bc092916469715a7aac9bc239973b331819236c60045a6f95c306bea" exitCode=0
Jul 01 20:54:34.263333 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:34.263255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7" event={"ID":"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b","Type":"ContainerDied","Data":"404c9e38bc092916469715a7aac9bc239973b331819236c60045a6f95c306bea"}
Jul 01 20:54:35.270101 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.270066    2569 generic.go:356] "Generic (PLEG): container finished" podID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerID="2f7ddf8eaedc80afc1a1de65dfd018131dbb12ab208e17fa17ed2f1cfff5b51f" exitCode=0
Jul 01 20:54:35.270505 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.270147    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w" event={"ID":"9c49303d-7d82-45c6-a2f9-6dc574d71705","Type":"ContainerDied","Data":"2f7ddf8eaedc80afc1a1de65dfd018131dbb12ab208e17fa17ed2f1cfff5b51f"}
Jul 01 20:54:35.272634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.272610    2569 generic.go:356] "Generic (PLEG): container finished" podID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerID="45c6ecc0cd2d9b4fde689620b204c36bad36c2921ec442633eb5c7e5a3911ba0" exitCode=0
Jul 01 20:54:35.272730 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.272696    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb" event={"ID":"d58f1cf7-6ac3-4011-93e8-650cf605f239","Type":"ContainerDied","Data":"45c6ecc0cd2d9b4fde689620b204c36bad36c2921ec442633eb5c7e5a3911ba0"}
Jul 01 20:54:35.275053 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.275031    2569 generic.go:356] "Generic (PLEG): container finished" podID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerID="8a22123c7890287fcb48f11f1646333df5c8ca6c59842b38ed15ab4eccb937ba" exitCode=0
Jul 01 20:54:35.275172 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.275105    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b" event={"ID":"6654c881-3b3b-427b-b9d0-15f72fee0e57","Type":"ContainerDied","Data":"8a22123c7890287fcb48f11f1646333df5c8ca6c59842b38ed15ab4eccb937ba"}
Jul 01 20:54:35.277241 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.277218    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerID="e598d8ef7387e73d4132649fe6b3beef275248792e3245c40a622ff25240f6f3" exitCode=0
Jul 01 20:54:35.277338 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:35.277283    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7" event={"ID":"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b","Type":"ContainerDied","Data":"e598d8ef7387e73d4132649fe6b3beef275248792e3245c40a622ff25240f6f3"}
Jul 01 20:54:36.288697 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.288644    2569 generic.go:356] "Generic (PLEG): container finished" podID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerID="fe9f1ced3bd3e6763471a96a1bb5e7591515182333500f016f6091c93067eb07" exitCode=0
Jul 01 20:54:36.289196 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.288729    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w" event={"ID":"9c49303d-7d82-45c6-a2f9-6dc574d71705","Type":"ContainerDied","Data":"fe9f1ced3bd3e6763471a96a1bb5e7591515182333500f016f6091c93067eb07"}
Jul 01 20:54:36.432279 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.432252    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:36.476511 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.476491    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:36.479199 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.479172    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:36.568345 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568278    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-util\") pod \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") "
Jul 01 20:54:36.568345 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568326    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-util\") pod \"d58f1cf7-6ac3-4011-93e8-650cf605f239\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") "
Jul 01 20:54:36.568522 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568362    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-bundle\") pod \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") "
Jul 01 20:54:36.568522 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568390    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lplx\" (UniqueName: \"kubernetes.io/projected/6654c881-3b3b-427b-b9d0-15f72fee0e57-kube-api-access-9lplx\") pod \"6654c881-3b3b-427b-b9d0-15f72fee0e57\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") "
Jul 01 20:54:36.568522 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568423    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-util\") pod \"6654c881-3b3b-427b-b9d0-15f72fee0e57\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") "
Jul 01 20:54:36.568522 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568450    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-bundle\") pod \"d58f1cf7-6ac3-4011-93e8-650cf605f239\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") "
Jul 01 20:54:36.568710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568546    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scl69\" (UniqueName: \"kubernetes.io/projected/d58f1cf7-6ac3-4011-93e8-650cf605f239-kube-api-access-scl69\") pod \"d58f1cf7-6ac3-4011-93e8-650cf605f239\" (UID: \"d58f1cf7-6ac3-4011-93e8-650cf605f239\") "
Jul 01 20:54:36.568710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568645    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hzrv\" (UniqueName: \"kubernetes.io/projected/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-kube-api-access-6hzrv\") pod \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\" (UID: \"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b\") "
Jul 01 20:54:36.568710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568672    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-bundle\") pod \"6654c881-3b3b-427b-b9d0-15f72fee0e57\" (UID: \"6654c881-3b3b-427b-b9d0-15f72fee0e57\") "
Jul 01 20:54:36.568906 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568881    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-bundle" (OuterVolumeSpecName: "bundle") pod "c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" (UID: "c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:36.568955 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.568919    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-bundle" (OuterVolumeSpecName: "bundle") pod "d58f1cf7-6ac3-4011-93e8-650cf605f239" (UID: "d58f1cf7-6ac3-4011-93e8-650cf605f239"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:36.569594 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.569570    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-bundle" (OuterVolumeSpecName: "bundle") pod "6654c881-3b3b-427b-b9d0-15f72fee0e57" (UID: "6654c881-3b3b-427b-b9d0-15f72fee0e57"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:36.571424 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.571397    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d58f1cf7-6ac3-4011-93e8-650cf605f239-kube-api-access-scl69" (OuterVolumeSpecName: "kube-api-access-scl69") pod "d58f1cf7-6ac3-4011-93e8-650cf605f239" (UID: "d58f1cf7-6ac3-4011-93e8-650cf605f239"). InnerVolumeSpecName "kube-api-access-scl69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:54:36.571490 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.571427    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-kube-api-access-6hzrv" (OuterVolumeSpecName: "kube-api-access-6hzrv") pod "c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" (UID: "c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b"). InnerVolumeSpecName "kube-api-access-6hzrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:54:36.571490 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.571479    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6654c881-3b3b-427b-b9d0-15f72fee0e57-kube-api-access-9lplx" (OuterVolumeSpecName: "kube-api-access-9lplx") pod "6654c881-3b3b-427b-b9d0-15f72fee0e57" (UID: "6654c881-3b3b-427b-b9d0-15f72fee0e57"). InnerVolumeSpecName "kube-api-access-9lplx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:54:36.574367 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.574334    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-util" (OuterVolumeSpecName: "util") pod "6654c881-3b3b-427b-b9d0-15f72fee0e57" (UID: "6654c881-3b3b-427b-b9d0-15f72fee0e57"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:36.574548 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.574530    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-util" (OuterVolumeSpecName: "util") pod "c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" (UID: "c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:36.575075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.575056    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-util" (OuterVolumeSpecName: "util") pod "d58f1cf7-6ac3-4011-93e8-650cf605f239" (UID: "d58f1cf7-6ac3-4011-93e8-650cf605f239"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:36.669609 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669586    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hzrv\" (UniqueName: \"kubernetes.io/projected/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-kube-api-access-6hzrv\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669609 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669606    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669615    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-util\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669624    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-util\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669631    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669640    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lplx\" (UniqueName: \"kubernetes.io/projected/6654c881-3b3b-427b-b9d0-15f72fee0e57-kube-api-access-9lplx\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669648    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6654c881-3b3b-427b-b9d0-15f72fee0e57-util\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669656    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f1cf7-6ac3-4011-93e8-650cf605f239-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:36.669704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:36.669663    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scl69\" (UniqueName: \"kubernetes.io/projected/d58f1cf7-6ac3-4011-93e8-650cf605f239-kube-api-access-scl69\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:37.296423 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.296342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb" event={"ID":"d58f1cf7-6ac3-4011-93e8-650cf605f239","Type":"ContainerDied","Data":"40e66116b1e1b53117d59b305d03eee1862a386bafc9c82893992665e9bef33d"}
Jul 01 20:54:37.296791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.296431    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40e66116b1e1b53117d59b305d03eee1862a386bafc9c82893992665e9bef33d"
Jul 01 20:54:37.296791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.296360    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36gspjb"
Jul 01 20:54:37.298487 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.298421    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b"
Jul 01 20:54:37.298487 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.298428    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabdfr8b" event={"ID":"6654c881-3b3b-427b-b9d0-15f72fee0e57","Type":"ContainerDied","Data":"a456686c581b8cdf639415c57a6469053aed2e35a7b591e7197e741a0825c84e"}
Jul 01 20:54:37.298487 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.298477    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a456686c581b8cdf639415c57a6469053aed2e35a7b591e7197e741a0825c84e"
Jul 01 20:54:37.300919 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.300889    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7" event={"ID":"c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b","Type":"ContainerDied","Data":"df361ead714870fdc8cf2535673dd409a00706c74d416c2bcf3842e10b2c5791"}
Jul 01 20:54:37.301063 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.300933    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df361ead714870fdc8cf2535673dd409a00706c74d416c2bcf3842e10b2c5791"
Jul 01 20:54:37.301063 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.300963    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efvl9q7"
Jul 01 20:54:37.424171 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.424149    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:37.579166 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.579102    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-util\") pod \"9c49303d-7d82-45c6-a2f9-6dc574d71705\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") "
Jul 01 20:54:37.579166 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.579134    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-bundle\") pod \"9c49303d-7d82-45c6-a2f9-6dc574d71705\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") "
Jul 01 20:54:37.579355 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.579209    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnl44\" (UniqueName: \"kubernetes.io/projected/9c49303d-7d82-45c6-a2f9-6dc574d71705-kube-api-access-jnl44\") pod \"9c49303d-7d82-45c6-a2f9-6dc574d71705\" (UID: \"9c49303d-7d82-45c6-a2f9-6dc574d71705\") "
Jul 01 20:54:37.579751 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.579725    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-bundle" (OuterVolumeSpecName: "bundle") pod "9c49303d-7d82-45c6-a2f9-6dc574d71705" (UID: "9c49303d-7d82-45c6-a2f9-6dc574d71705"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:37.581383 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.581359    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c49303d-7d82-45c6-a2f9-6dc574d71705-kube-api-access-jnl44" (OuterVolumeSpecName: "kube-api-access-jnl44") pod "9c49303d-7d82-45c6-a2f9-6dc574d71705" (UID: "9c49303d-7d82-45c6-a2f9-6dc574d71705"). InnerVolumeSpecName "kube-api-access-jnl44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:54:37.584316 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.584296    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-util" (OuterVolumeSpecName: "util") pod "9c49303d-7d82-45c6-a2f9-6dc574d71705" (UID: "9c49303d-7d82-45c6-a2f9-6dc574d71705"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:54:37.679812 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.679789    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnl44\" (UniqueName: \"kubernetes.io/projected/9c49303d-7d82-45c6-a2f9-6dc574d71705-kube-api-access-jnl44\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:37.679812 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.679809    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-util\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:37.679939 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:37.679820    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c49303d-7d82-45c6-a2f9-6dc574d71705-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:38.307852 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:38.307824    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w"
Jul 01 20:54:38.308246 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:38.307813    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76c424w" event={"ID":"9c49303d-7d82-45c6-a2f9-6dc574d71705","Type":"ContainerDied","Data":"e0e57b31a37b47ecf824dc958274db0241675986f0e704f698ea2824e673274b"}
Jul 01 20:54:38.308246 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:38.307944    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0e57b31a37b47ecf824dc958274db0241675986f0e704f698ea2824e673274b"
Jul 01 20:54:39.615373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:39.615341    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:40.490509 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:40.490479    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:42.892401 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892364    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-s4vc7"]
Jul 01 20:54:42.892881 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892862    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerName="util"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892885    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerName="util"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892896    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerName="extract"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892904    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerName="extract"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892922    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerName="util"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892930    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerName="util"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892943    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerName="pull"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892951    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerName="pull"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892962    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerName="extract"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892969    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerName="extract"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892981    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerName="pull"
Jul 01 20:54:42.892983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.892989    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerName="pull"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893015    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerName="extract"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893024    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerName="extract"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893033    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerName="pull"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893041    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerName="pull"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893057    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerName="extract"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893065    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerName="extract"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893076    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerName="util"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893085    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerName="util"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893095    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerName="util"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893104    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerName="util"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893112    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerName="pull"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893119    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerName="pull"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893221    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d58f1cf7-6ac3-4011-93e8-650cf605f239" containerName="extract"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893234    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6654c881-3b3b-427b-b9d0-15f72fee0e57" containerName="extract"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893244    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3bb51b8-44af-4f68-a1a4-a3e5e5ed012b" containerName="extract"
Jul 01 20:54:42.893495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.893255    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c49303d-7d82-45c6-a2f9-6dc574d71705" containerName="extract"
Jul 01 20:54:42.896883 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.896861    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7"
Jul 01 20:54:42.899428 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.899407    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 01 20:54:42.899556 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.899433    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8tfhb\""
Jul 01 20:54:42.899556 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.899408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 01 20:54:42.905805 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:42.905784    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-s4vc7"]
Jul 01 20:54:43.014101 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.014072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv5dw\" (UniqueName: \"kubernetes.io/projected/c8a4502d-4883-422d-bf98-04777c40e595-kube-api-access-zv5dw\") pod \"authorino-operator-6d85f6564-s4vc7\" (UID: \"c8a4502d-4883-422d-bf98-04777c40e595\") " pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7"
Jul 01 20:54:43.115141 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.115112    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv5dw\" (UniqueName: \"kubernetes.io/projected/c8a4502d-4883-422d-bf98-04777c40e595-kube-api-access-zv5dw\") pod \"authorino-operator-6d85f6564-s4vc7\" (UID: \"c8a4502d-4883-422d-bf98-04777c40e595\") " pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7"
Jul 01 20:54:43.135054 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.135026    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv5dw\" (UniqueName: \"kubernetes.io/projected/c8a4502d-4883-422d-bf98-04777c40e595-kube-api-access-zv5dw\") pod \"authorino-operator-6d85f6564-s4vc7\" (UID: \"c8a4502d-4883-422d-bf98-04777c40e595\") " pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7"
Jul 01 20:54:43.206895 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.206846    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7"
Jul 01 20:54:43.351020 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.350984    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-s4vc7"]
Jul 01 20:54:43.353272 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:43.353248    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a4502d_4883_422d_bf98_04777c40e595.slice/crio-a84905a8c93f1fafcbf7a931857c09df2e35a2de094a3766a73132eca5d73b46 WatchSource:0}: Error finding container a84905a8c93f1fafcbf7a931857c09df2e35a2de094a3766a73132eca5d73b46: Status 404 returned error can't find the container with id a84905a8c93f1fafcbf7a931857c09df2e35a2de094a3766a73132eca5d73b46
Jul 01 20:54:43.477450 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.477385    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:43.674535 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.674504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:43.787626 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.787544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:43.892505 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:43.892465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:44.339188 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:44.339158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7" event={"ID":"c8a4502d-4883-422d-bf98-04777c40e595","Type":"ContainerStarted","Data":"a84905a8c93f1fafcbf7a931857c09df2e35a2de094a3766a73132eca5d73b46"}
Jul 01 20:54:44.416480 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:44.416448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:46.103349 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:46.103319    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:46.202214 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:46.202186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:47.323499 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.323466    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"]
Jul 01 20:54:47.327384 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.327359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.344332 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.344314    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-98kxh\""
Jul 01 20:54:47.355545 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.355520    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"]
Jul 01 20:54:47.447619 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.447582    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz\" (UID: \"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.447769 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.447728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c99gf\" (UniqueName: \"kubernetes.io/projected/9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e-kube-api-access-c99gf\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz\" (UID: \"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.548221 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.548194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz\" (UID: \"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.548354 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.548272    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c99gf\" (UniqueName: \"kubernetes.io/projected/9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e-kube-api-access-c99gf\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz\" (UID: \"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.548598 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.548574    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz\" (UID: \"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.558943 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.558919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c99gf\" (UniqueName: \"kubernetes.io/projected/9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e-kube-api-access-c99gf\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz\" (UID: \"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.639749 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.639729    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:47.789184 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.789155    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"]
Jul 01 20:54:47.791839 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:54:47.791801    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac519ff_13fa_4dd5_97f4_71bcdcec2b1e.slice/crio-7f920672f2542b9f21a4f69cf733d57471dec3f9684dbd0714c83f8f5a989f87 WatchSource:0}: Error finding container 7f920672f2542b9f21a4f69cf733d57471dec3f9684dbd0714c83f8f5a989f87: Status 404 returned error can't find the container with id 7f920672f2542b9f21a4f69cf733d57471dec3f9684dbd0714c83f8f5a989f87
Jul 01 20:54:47.829948 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:47.829924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:48.364303 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:48.364264    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7" event={"ID":"c8a4502d-4883-422d-bf98-04777c40e595","Type":"ContainerStarted","Data":"e489c4ab90aebc11cdea38d3009a7c97c316f0327f4a4de426cff950fbd18502"}
Jul 01 20:54:48.364721 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:48.364334    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7"
Jul 01 20:54:48.365702 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:48.365680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz" event={"ID":"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e","Type":"ContainerStarted","Data":"7f920672f2542b9f21a4f69cf733d57471dec3f9684dbd0714c83f8f5a989f87"}
Jul 01 20:54:48.384230 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:48.384184    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7" podStartSLOduration=2.191576679 podStartE2EDuration="6.384169597s" totalImagesPullingTime="4.192592918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:54:48.382375187 +0000 UTC m=+493.978261501" watchObservedRunningTime="2026-07-01 20:54:48.384169597 +0000 UTC m=+493.980055915"
Jul 01 20:54:48.904075 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:48.904041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:49.266958 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.266879    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c6dfc47bf-cmfrl" podUID="f38d2da4-f4cf-450b-a8ac-bb2939338d7a" containerName="console" containerID="cri-o://4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49" gracePeriod=15
Jul 01 20:54:49.534548 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.534461    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:54:49.667627 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.667593    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-serving-cert\") pod \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") "
Jul 01 20:54:49.667776 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.667650    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-service-ca\") pod \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") "
Jul 01 20:54:49.667776 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.667669    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwd4x\" (UniqueName: \"kubernetes.io/projected/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-kube-api-access-dwd4x\") pod \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") "
Jul 01 20:54:49.667776 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.667692    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-oauth-serving-cert\") pod \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") "
Jul 01 20:54:49.667776 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.667727    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-trusted-ca-bundle\") pod \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") "
Jul 01 20:54:49.667776 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.667760    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-config\") pod \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") "
Jul 01 20:54:49.668041 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.667817    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-oauth-config\") pod \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\" (UID: \"f38d2da4-f4cf-450b-a8ac-bb2939338d7a\") "
Jul 01 20:54:49.668346 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.668300    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f38d2da4-f4cf-450b-a8ac-bb2939338d7a" (UID: "f38d2da4-f4cf-450b-a8ac-bb2939338d7a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:54:49.668346 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.668303    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-config" (OuterVolumeSpecName: "console-config") pod "f38d2da4-f4cf-450b-a8ac-bb2939338d7a" (UID: "f38d2da4-f4cf-450b-a8ac-bb2939338d7a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:54:49.668527 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.668355    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f38d2da4-f4cf-450b-a8ac-bb2939338d7a" (UID: "f38d2da4-f4cf-450b-a8ac-bb2939338d7a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:54:49.668527 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.668371    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f38d2da4-f4cf-450b-a8ac-bb2939338d7a" (UID: "f38d2da4-f4cf-450b-a8ac-bb2939338d7a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:54:49.670258 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.670235    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f38d2da4-f4cf-450b-a8ac-bb2939338d7a" (UID: "f38d2da4-f4cf-450b-a8ac-bb2939338d7a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:54:49.670411 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.670390    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f38d2da4-f4cf-450b-a8ac-bb2939338d7a" (UID: "f38d2da4-f4cf-450b-a8ac-bb2939338d7a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:54:49.670477 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.670418    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-kube-api-access-dwd4x" (OuterVolumeSpecName: "kube-api-access-dwd4x") pod "f38d2da4-f4cf-450b-a8ac-bb2939338d7a" (UID: "f38d2da4-f4cf-450b-a8ac-bb2939338d7a"). InnerVolumeSpecName "kube-api-access-dwd4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:54:49.769257 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.769237    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:49.769257 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.769259    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-service-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:49.769454 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.769268    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwd4x\" (UniqueName: \"kubernetes.io/projected/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-kube-api-access-dwd4x\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:49.769454 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.769281    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-oauth-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:49.769454 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.769295    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:49.769454 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.769305    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:49.769454 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:49.769319    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38d2da4-f4cf-450b-a8ac-bb2939338d7a-console-oauth-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:54:50.381862 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.381826    2569 generic.go:356] "Generic (PLEG): container finished" podID="f38d2da4-f4cf-450b-a8ac-bb2939338d7a" containerID="4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49" exitCode=0
Jul 01 20:54:50.382062 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.381876    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dfc47bf-cmfrl"
Jul 01 20:54:50.382062 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.381900    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dfc47bf-cmfrl" event={"ID":"f38d2da4-f4cf-450b-a8ac-bb2939338d7a","Type":"ContainerDied","Data":"4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49"}
Jul 01 20:54:50.382062 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.381948    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dfc47bf-cmfrl" event={"ID":"f38d2da4-f4cf-450b-a8ac-bb2939338d7a","Type":"ContainerDied","Data":"a69b09efaea110daa1e01823b80a151fae19e69b8582085ccbd4c95a0d76ef76"}
Jul 01 20:54:50.382062 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.381974    2569 scope.go:117] "RemoveContainer" containerID="4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49"
Jul 01 20:54:50.393542 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.393521    2569 scope.go:117] "RemoveContainer" containerID="4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49"
Jul 01 20:54:50.393822 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:54:50.393797    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49\": container with ID starting with 4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49 not found: ID does not exist" containerID="4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49"
Jul 01 20:54:50.393903 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.393834    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49"} err="failed to get container status \"4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49\": rpc error: code = NotFound desc = could not find container \"4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49\": container with ID starting with 4065c67bd1eaeb4f56ec7e4db270c48dd06068d252d95fb41de17bdce7e8ec49 not found: ID does not exist"
Jul 01 20:54:50.407117 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.407095    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6dfc47bf-cmfrl"]
Jul 01 20:54:50.415145 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.415124    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6dfc47bf-cmfrl"]
Jul 01 20:54:50.827631 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.827540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:50.966651 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:50.966621    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f38d2da4-f4cf-450b-a8ac-bb2939338d7a" path="/var/lib/kubelet/pods/f38d2da4-f4cf-450b-a8ac-bb2939338d7a/volumes"
Jul 01 20:54:51.483028 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:51.482967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:52.395501 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:52.395473    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz" event={"ID":"9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e","Type":"ContainerStarted","Data":"b3365dc028aefe676bc594161a13f46104b7b1e339b56f0538383c24217f242b"}
Jul 01 20:54:52.395932 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:52.395543    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:54:52.422435 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:52.422386    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz" podStartSLOduration=1.345211079 podStartE2EDuration="5.422369537s" totalImagesPullingTime="4.077158458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:54:52.420745047 +0000 UTC m=+498.016631360" watchObservedRunningTime="2026-07-01 20:54:52.422369537 +0000 UTC m=+498.018255850"
Jul 01 20:54:53.042554 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:53.042526    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:53.143411 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:53.143379    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:53.429862 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:53.429833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:53.528132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:53.528106    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:54.110422 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:54.110390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:54.205330 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:54.205298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:59.028159 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:59.028125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:59.087265 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:59.087242    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:54:59.374510 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:59.374482    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-s4vc7"
Jul 01 20:54:59.672429 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:54:59.672354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:00.486253 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:00.486223    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:00.576706 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:00.576674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:03.403711 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:03.403678    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz"
Jul 01 20:55:05.102628 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:05.102592    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:05.204634 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:05.204596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:07.602298 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:07.602268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:07.664466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:07.664435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:13.088326 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:13.088291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:13.146374 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:13.146346    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:13.689322 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:13.689292    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:13.755622 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:13.755597    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:18.292712 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:18.292680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:18.393182 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:18.393151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:18.699632 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:18.699596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:18.799757 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:18.799728    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:19.094225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:19.094193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:19.195446 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:19.195416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:24.998292 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:24.998260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:25.104479 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:25.104447    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:27.399800 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:27.399721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:27.463118 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:27.463092    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:36.285615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.285584    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:36.293379 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.293352    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"]
Jul 01 20:55:36.293703 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.293690    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f38d2da4-f4cf-450b-a8ac-bb2939338d7a" containerName="console"
Jul 01 20:55:36.293747 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.293705    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f38d2da4-f4cf-450b-a8ac-bb2939338d7a" containerName="console"
Jul 01 20:55:36.293789 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.293779    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f38d2da4-f4cf-450b-a8ac-bb2939338d7a" containerName="console"
Jul 01 20:55:36.296557 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.296539    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.298929 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.298912    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 01 20:55:36.299007 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.298950    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xp5xs\""
Jul 01 20:55:36.305186 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.305165    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"]
Jul 01 20:55:36.396140 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.396111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"]
Jul 01 20:55:36.416806 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.416778    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:36.417893 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.417863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e115e3-0def-4b9f-8117-06bb145110e1-config-file\") pod \"limitador-limitador-ff68ff5cb-hpwld\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.418005 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.417896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8btbx\" (UniqueName: \"kubernetes.io/projected/07e115e3-0def-4b9f-8117-06bb145110e1-kube-api-access-8btbx\") pod \"limitador-limitador-ff68ff5cb-hpwld\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.517123 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.517097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:36.518731 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.518712    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e115e3-0def-4b9f-8117-06bb145110e1-config-file\") pod \"limitador-limitador-ff68ff5cb-hpwld\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.518792 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.518741    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8btbx\" (UniqueName: \"kubernetes.io/projected/07e115e3-0def-4b9f-8117-06bb145110e1-kube-api-access-8btbx\") pod \"limitador-limitador-ff68ff5cb-hpwld\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.519380 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.519365    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e115e3-0def-4b9f-8117-06bb145110e1-config-file\") pod \"limitador-limitador-ff68ff5cb-hpwld\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.526492 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.526468    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8btbx\" (UniqueName: \"kubernetes.io/projected/07e115e3-0def-4b9f-8117-06bb145110e1-kube-api-access-8btbx\") pod \"limitador-limitador-ff68ff5cb-hpwld\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.607613 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.607589    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:36.939989 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:36.939969    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"]
Jul 01 20:55:36.941846 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:55:36.941819    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e115e3_0def_4b9f_8117_06bb145110e1.slice/crio-bb56eb4cdef9dedb7be5ee60ac7a886f8ca04b68bd038d773a5598cb62fbb72e WatchSource:0}: Error finding container bb56eb4cdef9dedb7be5ee60ac7a886f8ca04b68bd038d773a5598cb62fbb72e: Status 404 returned error can't find the container with id bb56eb4cdef9dedb7be5ee60ac7a886f8ca04b68bd038d773a5598cb62fbb72e
Jul 01 20:55:37.130098 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.130067    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:37.232591 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.232524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:37.233794 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.233774    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8df697c9f-nr87c"]
Jul 01 20:55:37.236724 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.236705    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-nr87c"
Jul 01 20:55:37.238881 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.238866    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zkbf2\""
Jul 01 20:55:37.244742 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.244720    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-nr87c"]
Jul 01 20:55:37.324018 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.323975    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zppg\" (UniqueName: \"kubernetes.io/projected/65ceca35-f7bf-46f4-b71e-386ac554209d-kube-api-access-6zppg\") pod \"authorino-8df697c9f-nr87c\" (UID: \"65ceca35-f7bf-46f4-b71e-386ac554209d\") " pod="kuadrant-system/authorino-8df697c9f-nr87c"
Jul 01 20:55:37.424826 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.424793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zppg\" (UniqueName: \"kubernetes.io/projected/65ceca35-f7bf-46f4-b71e-386ac554209d-kube-api-access-6zppg\") pod \"authorino-8df697c9f-nr87c\" (UID: \"65ceca35-f7bf-46f4-b71e-386ac554209d\") " pod="kuadrant-system/authorino-8df697c9f-nr87c"
Jul 01 20:55:37.433605 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.433566    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zppg\" (UniqueName: \"kubernetes.io/projected/65ceca35-f7bf-46f4-b71e-386ac554209d-kube-api-access-6zppg\") pod \"authorino-8df697c9f-nr87c\" (UID: \"65ceca35-f7bf-46f4-b71e-386ac554209d\") " pod="kuadrant-system/authorino-8df697c9f-nr87c"
Jul 01 20:55:37.557728 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.557667    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-nr87c"
Jul 01 20:55:37.636562 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.636536    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld" event={"ID":"07e115e3-0def-4b9f-8117-06bb145110e1","Type":"ContainerStarted","Data":"bb56eb4cdef9dedb7be5ee60ac7a886f8ca04b68bd038d773a5598cb62fbb72e"}
Jul 01 20:55:37.683900 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:37.683877    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-nr87c"]
Jul 01 20:55:37.685830 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:55:37.685805    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65ceca35_f7bf_46f4_b71e_386ac554209d.slice/crio-cebaf5ad117b16147389b7d682ef2bec3fbb8ef83f60f5923219c3f850b8f68b WatchSource:0}: Error finding container cebaf5ad117b16147389b7d682ef2bec3fbb8ef83f60f5923219c3f850b8f68b: Status 404 returned error can't find the container with id cebaf5ad117b16147389b7d682ef2bec3fbb8ef83f60f5923219c3f850b8f68b
Jul 01 20:55:38.645468 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:38.645430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-nr87c" event={"ID":"65ceca35-f7bf-46f4-b71e-386ac554209d","Type":"ContainerStarted","Data":"cebaf5ad117b16147389b7d682ef2bec3fbb8ef83f60f5923219c3f850b8f68b"}
Jul 01 20:55:39.022580 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:39.022481    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:41.832552 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:41.832514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:42.006985 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:42.006947    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:42.668704 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:42.668664    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-nr87c" event={"ID":"65ceca35-f7bf-46f4-b71e-386ac554209d","Type":"ContainerStarted","Data":"19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a"}
Jul 01 20:55:42.670140 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:42.670116    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld" event={"ID":"07e115e3-0def-4b9f-8117-06bb145110e1","Type":"ContainerStarted","Data":"d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448"}
Jul 01 20:55:42.670246 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:42.670170    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:42.684883 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:42.684839    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8df697c9f-nr87c" podStartSLOduration=1.227545352 podStartE2EDuration="5.684824799s" totalImagesPullingTime="4.457279447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:55:42.683380857 +0000 UTC m=+548.279267171" watchObservedRunningTime="2026-07-01 20:55:42.684824799 +0000 UTC m=+548.280711112"
Jul 01 20:55:42.700939 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:42.700899    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld" podStartSLOduration=1.49045206 podStartE2EDuration="6.700885138s" totalImagesPullingTime="5.210433078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:55:42.699689996 +0000 UTC m=+548.295576309" watchObservedRunningTime="2026-07-01 20:55:42.700885138 +0000 UTC m=+548.296771451"
Jul 01 20:55:53.120410 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.120379    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"]
Jul 01 20:55:53.120871 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.120650    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld" podUID="07e115e3-0def-4b9f-8117-06bb145110e1" containerName="limitador" containerID="cri-o://d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448" gracePeriod=30
Jul 01 20:55:53.122341 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.122317    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:53.676797 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.676776    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:53.723766 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.723686    2569 generic.go:356] "Generic (PLEG): container finished" podID="07e115e3-0def-4b9f-8117-06bb145110e1" containerID="d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448" exitCode=0
Jul 01 20:55:53.723766 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.723730    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"
Jul 01 20:55:53.723913 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.723776    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld" event={"ID":"07e115e3-0def-4b9f-8117-06bb145110e1","Type":"ContainerDied","Data":"d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448"}
Jul 01 20:55:53.723913 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.723827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-hpwld" event={"ID":"07e115e3-0def-4b9f-8117-06bb145110e1","Type":"ContainerDied","Data":"bb56eb4cdef9dedb7be5ee60ac7a886f8ca04b68bd038d773a5598cb62fbb72e"}
Jul 01 20:55:53.723913 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.723853    2569 scope.go:117] "RemoveContainer" containerID="d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448"
Jul 01 20:55:53.732147 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.732126    2569 scope.go:117] "RemoveContainer" containerID="d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448"
Jul 01 20:55:53.732399 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:55:53.732380    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448\": container with ID starting with d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448 not found: ID does not exist" containerID="d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448"
Jul 01 20:55:53.732466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.732407    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448"} err="failed to get container status \"d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448\": rpc error: code = NotFound desc = could not find container \"d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448\": container with ID starting with d2185f3ea2e038bcfc3b705158de765d55b2166301f5abdc52fa7b657cd85448 not found: ID does not exist"
Jul 01 20:55:53.757835 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.757815    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8btbx\" (UniqueName: \"kubernetes.io/projected/07e115e3-0def-4b9f-8117-06bb145110e1-kube-api-access-8btbx\") pod \"07e115e3-0def-4b9f-8117-06bb145110e1\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") "
Jul 01 20:55:53.757917 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.757844    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e115e3-0def-4b9f-8117-06bb145110e1-config-file\") pod \"07e115e3-0def-4b9f-8117-06bb145110e1\" (UID: \"07e115e3-0def-4b9f-8117-06bb145110e1\") "
Jul 01 20:55:53.758226 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.758204    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e115e3-0def-4b9f-8117-06bb145110e1-config-file" (OuterVolumeSpecName: "config-file") pod "07e115e3-0def-4b9f-8117-06bb145110e1" (UID: "07e115e3-0def-4b9f-8117-06bb145110e1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:55:53.759840 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.759816    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e115e3-0def-4b9f-8117-06bb145110e1-kube-api-access-8btbx" (OuterVolumeSpecName: "kube-api-access-8btbx") pod "07e115e3-0def-4b9f-8117-06bb145110e1" (UID: "07e115e3-0def-4b9f-8117-06bb145110e1"). InnerVolumeSpecName "kube-api-access-8btbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:55:53.858406 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.858377    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8btbx\" (UniqueName: \"kubernetes.io/projected/07e115e3-0def-4b9f-8117-06bb145110e1-kube-api-access-8btbx\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:55:53.858406 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:53.858401    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07e115e3-0def-4b9f-8117-06bb145110e1-config-file\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:55:54.044225 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:54.044203    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"]
Jul 01 20:55:54.050484 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:54.050459    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-hpwld"]
Jul 01 20:55:54.965784 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:54.965743    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e115e3-0def-4b9f-8117-06bb145110e1" path="/var/lib/kubelet/pods/07e115e3-0def-4b9f-8117-06bb145110e1/volumes"
Jul 01 20:55:59.279322 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:59.279287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:55:59.569327 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:55:59.569240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:56:02.966436 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:02.966405    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c77957575-nf65n"]
Jul 01 20:56:02.966791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:02.966720    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e115e3-0def-4b9f-8117-06bb145110e1" containerName="limitador"
Jul 01 20:56:02.966791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:02.966731    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e115e3-0def-4b9f-8117-06bb145110e1" containerName="limitador"
Jul 01 20:56:02.966865 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:02.966806    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e115e3-0def-4b9f-8117-06bb145110e1" containerName="limitador"
Jul 01 20:56:02.968945 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:02.968929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:02.971447 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:02.971426    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 01 20:56:02.974719 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:02.974697    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-nf65n"]
Jul 01 20:56:03.129336 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.129298    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e36cf1-071a-4b8b-a8f9-92243a855c41-tls-cert\") pod \"authorino-7c77957575-nf65n\" (UID: \"c1e36cf1-071a-4b8b-a8f9-92243a855c41\") " pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:03.129336 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.129337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w7pv\" (UniqueName: \"kubernetes.io/projected/c1e36cf1-071a-4b8b-a8f9-92243a855c41-kube-api-access-4w7pv\") pod \"authorino-7c77957575-nf65n\" (UID: \"c1e36cf1-071a-4b8b-a8f9-92243a855c41\") " pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:03.230388 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.230319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e36cf1-071a-4b8b-a8f9-92243a855c41-tls-cert\") pod \"authorino-7c77957575-nf65n\" (UID: \"c1e36cf1-071a-4b8b-a8f9-92243a855c41\") " pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:03.230388 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.230354    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w7pv\" (UniqueName: \"kubernetes.io/projected/c1e36cf1-071a-4b8b-a8f9-92243a855c41-kube-api-access-4w7pv\") pod \"authorino-7c77957575-nf65n\" (UID: \"c1e36cf1-071a-4b8b-a8f9-92243a855c41\") " pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:03.232764 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.232744    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e36cf1-071a-4b8b-a8f9-92243a855c41-tls-cert\") pod \"authorino-7c77957575-nf65n\" (UID: \"c1e36cf1-071a-4b8b-a8f9-92243a855c41\") " pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:03.238766 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.238744    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w7pv\" (UniqueName: \"kubernetes.io/projected/c1e36cf1-071a-4b8b-a8f9-92243a855c41-kube-api-access-4w7pv\") pod \"authorino-7c77957575-nf65n\" (UID: \"c1e36cf1-071a-4b8b-a8f9-92243a855c41\") " pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:03.278903 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.278877    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-nf65n"
Jul 01 20:56:03.403402 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.403380    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-nf65n"]
Jul 01 20:56:03.404881 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:56:03.404855    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1e36cf1_071a_4b8b_a8f9_92243a855c41.slice/crio-91cad171cf8b1930ae517aff69e5270e131254cdd9b814503bef9e85ad4436a9 WatchSource:0}: Error finding container 91cad171cf8b1930ae517aff69e5270e131254cdd9b814503bef9e85ad4436a9: Status 404 returned error can't find the container with id 91cad171cf8b1930ae517aff69e5270e131254cdd9b814503bef9e85ad4436a9
Jul 01 20:56:03.776020 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:03.775974    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-nf65n" event={"ID":"c1e36cf1-071a-4b8b-a8f9-92243a855c41","Type":"ContainerStarted","Data":"91cad171cf8b1930ae517aff69e5270e131254cdd9b814503bef9e85ad4436a9"}
Jul 01 20:56:04.782574 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:04.782537    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-nf65n" event={"ID":"c1e36cf1-071a-4b8b-a8f9-92243a855c41","Type":"ContainerStarted","Data":"69373db8055f8447a90d40e7e3ac3757be12fa2b08737076ed4b02a07bfc39db"}
Jul 01 20:56:04.805624 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:04.805574    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c77957575-nf65n" podStartSLOduration=2.237128159 podStartE2EDuration="2.805548939s" totalImagesPullingTime="568.42078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:56:04.803246938 +0000 UTC m=+570.399133253" watchObservedRunningTime="2026-07-01 20:56:04.805548939 +0000 UTC m=+570.401435254"
Jul 01 20:56:04.863188 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:04.863161    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-nr87c"]
Jul 01 20:56:04.863338 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:04.863317    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-8df697c9f-nr87c" podUID="65ceca35-f7bf-46f4-b71e-386ac554209d" containerName="authorino" containerID="cri-o://19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a" gracePeriod=30
Jul 01 20:56:05.118410 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.118388    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-nr87c"
Jul 01 20:56:05.148516 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.148491    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zppg\" (UniqueName: \"kubernetes.io/projected/65ceca35-f7bf-46f4-b71e-386ac554209d-kube-api-access-6zppg\") pod \"65ceca35-f7bf-46f4-b71e-386ac554209d\" (UID: \"65ceca35-f7bf-46f4-b71e-386ac554209d\") "
Jul 01 20:56:05.150400 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.150372    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ceca35-f7bf-46f4-b71e-386ac554209d-kube-api-access-6zppg" (OuterVolumeSpecName: "kube-api-access-6zppg") pod "65ceca35-f7bf-46f4-b71e-386ac554209d" (UID: "65ceca35-f7bf-46f4-b71e-386ac554209d"). InnerVolumeSpecName "kube-api-access-6zppg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:56:05.249652 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.249628    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zppg\" (UniqueName: \"kubernetes.io/projected/65ceca35-f7bf-46f4-b71e-386ac554209d-kube-api-access-6zppg\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:56:05.789012 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.788963    2569 generic.go:356] "Generic (PLEG): container finished" podID="65ceca35-f7bf-46f4-b71e-386ac554209d" containerID="19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a" exitCode=0
Jul 01 20:56:05.789515 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.789017    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-nr87c"
Jul 01 20:56:05.789515 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.789046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-nr87c" event={"ID":"65ceca35-f7bf-46f4-b71e-386ac554209d","Type":"ContainerDied","Data":"19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a"}
Jul 01 20:56:05.789515 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.789080    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-nr87c" event={"ID":"65ceca35-f7bf-46f4-b71e-386ac554209d","Type":"ContainerDied","Data":"cebaf5ad117b16147389b7d682ef2bec3fbb8ef83f60f5923219c3f850b8f68b"}
Jul 01 20:56:05.789515 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.789099    2569 scope.go:117] "RemoveContainer" containerID="19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a"
Jul 01 20:56:05.799889 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.799873    2569 scope.go:117] "RemoveContainer" containerID="19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a"
Jul 01 20:56:05.800184 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:05.800165    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a\": container with ID starting with 19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a not found: ID does not exist" containerID="19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a"
Jul 01 20:56:05.800283 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.800191    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a"} err="failed to get container status \"19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a\": rpc error: code = NotFound desc = could not find container \"19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a\": container with ID starting with 19f70fd816cde5c3e813c214fa61671cdc01445719f5483a708c5f035379aa9a not found: ID does not exist"
Jul 01 20:56:05.813043 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.813021    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-nr87c"]
Jul 01 20:56:05.816408 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:05.816390    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8df697c9f-nr87c"]
Jul 01 20:56:06.964900 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:06.964867    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ceca35-f7bf-46f4-b71e-386ac554209d" path="/var/lib/kubelet/pods/65ceca35-f7bf-46f4-b71e-386ac554209d/volumes"
Jul 01 20:56:08.824971 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.824938    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-67485586b-hs5ft"]
Jul 01 20:56:08.825433 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.825160    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-67485586b-hs5ft" podUID="4ff06046-4bdd-495c-a458-be5653b6314a" containerName="manager" containerID="cri-o://04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a" gracePeriod=10
Jul 01 20:56:08.846094 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.846071    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-67485586b-v6pj6"]
Jul 01 20:56:08.846415 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.846404    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ceca35-f7bf-46f4-b71e-386ac554209d" containerName="authorino"
Jul 01 20:56:08.846458 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.846418    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ceca35-f7bf-46f4-b71e-386ac554209d" containerName="authorino"
Jul 01 20:56:08.846496 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.846492    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ceca35-f7bf-46f4-b71e-386ac554209d" containerName="authorino"
Jul 01 20:56:08.848441 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.848427    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:08.861094 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.861067    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-67485586b-v6pj6"]
Jul 01 20:56:08.874958 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.874904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj4zv\" (UniqueName: \"kubernetes.io/projected/ce9136bd-2a16-4a9d-ba29-95f96974db4a-kube-api-access-xj4zv\") pod \"kserve-controller-manager-67485586b-v6pj6\" (UID: \"ce9136bd-2a16-4a9d-ba29-95f96974db4a\") " pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:08.875089 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.875032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce9136bd-2a16-4a9d-ba29-95f96974db4a-cert\") pod \"kserve-controller-manager-67485586b-v6pj6\" (UID: \"ce9136bd-2a16-4a9d-ba29-95f96974db4a\") " pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:08.976139 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.976110    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce9136bd-2a16-4a9d-ba29-95f96974db4a-cert\") pod \"kserve-controller-manager-67485586b-v6pj6\" (UID: \"ce9136bd-2a16-4a9d-ba29-95f96974db4a\") " pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:08.976319 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.976177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj4zv\" (UniqueName: \"kubernetes.io/projected/ce9136bd-2a16-4a9d-ba29-95f96974db4a-kube-api-access-xj4zv\") pod \"kserve-controller-manager-67485586b-v6pj6\" (UID: \"ce9136bd-2a16-4a9d-ba29-95f96974db4a\") " pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:08.978497 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.978471    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce9136bd-2a16-4a9d-ba29-95f96974db4a-cert\") pod \"kserve-controller-manager-67485586b-v6pj6\" (UID: \"ce9136bd-2a16-4a9d-ba29-95f96974db4a\") " pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:08.983688 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:08.983662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj4zv\" (UniqueName: \"kubernetes.io/projected/ce9136bd-2a16-4a9d-ba29-95f96974db4a-kube-api-access-xj4zv\") pod \"kserve-controller-manager-67485586b-v6pj6\" (UID: \"ce9136bd-2a16-4a9d-ba29-95f96974db4a\") " pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:09.078417 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.078368    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:56:09.177552 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.177522    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ff06046-4bdd-495c-a458-be5653b6314a-cert\") pod \"4ff06046-4bdd-495c-a458-be5653b6314a\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") "
Jul 01 20:56:09.177552 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.177555    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2fvc\" (UniqueName: \"kubernetes.io/projected/4ff06046-4bdd-495c-a458-be5653b6314a-kube-api-access-j2fvc\") pod \"4ff06046-4bdd-495c-a458-be5653b6314a\" (UID: \"4ff06046-4bdd-495c-a458-be5653b6314a\") "
Jul 01 20:56:09.179615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.179590    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff06046-4bdd-495c-a458-be5653b6314a-cert" (OuterVolumeSpecName: "cert") pod "4ff06046-4bdd-495c-a458-be5653b6314a" (UID: "4ff06046-4bdd-495c-a458-be5653b6314a"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:56:09.179724 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.179632    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff06046-4bdd-495c-a458-be5653b6314a-kube-api-access-j2fvc" (OuterVolumeSpecName: "kube-api-access-j2fvc") pod "4ff06046-4bdd-495c-a458-be5653b6314a" (UID: "4ff06046-4bdd-495c-a458-be5653b6314a"). InnerVolumeSpecName "kube-api-access-j2fvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:56:09.203782 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.203759    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:09.278514 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.278487    2569 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ff06046-4bdd-495c-a458-be5653b6314a-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:56:09.278643 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.278519    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2fvc\" (UniqueName: \"kubernetes.io/projected/4ff06046-4bdd-495c-a458-be5653b6314a-kube-api-access-j2fvc\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:56:09.328251 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.328226    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-67485586b-v6pj6"]
Jul 01 20:56:09.330290 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:56:09.330238    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9136bd_2a16_4a9d_ba29_95f96974db4a.slice/crio-c234c62f0f106aeb7d63162077d2e9c435fb289bffa0c33b6cac37a500aa24c8 WatchSource:0}: Error finding container c234c62f0f106aeb7d63162077d2e9c435fb289bffa0c33b6cac37a500aa24c8: Status 404 returned error can't find the container with id c234c62f0f106aeb7d63162077d2e9c435fb289bffa0c33b6cac37a500aa24c8
Jul 01 20:56:09.811094 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.811061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-67485586b-v6pj6" event={"ID":"ce9136bd-2a16-4a9d-ba29-95f96974db4a","Type":"ContainerStarted","Data":"c234c62f0f106aeb7d63162077d2e9c435fb289bffa0c33b6cac37a500aa24c8"}
Jul 01 20:56:09.812327 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.812297    2569 generic.go:356] "Generic (PLEG): container finished" podID="4ff06046-4bdd-495c-a458-be5653b6314a" containerID="04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a" exitCode=0
Jul 01 20:56:09.812447 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.812341    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-67485586b-hs5ft"
Jul 01 20:56:09.812447 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.812378    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-67485586b-hs5ft" event={"ID":"4ff06046-4bdd-495c-a458-be5653b6314a","Type":"ContainerDied","Data":"04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a"}
Jul 01 20:56:09.812447 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.812422    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-67485586b-hs5ft" event={"ID":"4ff06046-4bdd-495c-a458-be5653b6314a","Type":"ContainerDied","Data":"537c93767a450a47cf96b4af776faaf149962aaa74600cd6433ce8900d1a17b4"}
Jul 01 20:56:09.812447 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.812446    2569 scope.go:117] "RemoveContainer" containerID="04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a"
Jul 01 20:56:09.820866 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.820851    2569 scope.go:117] "RemoveContainer" containerID="04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a"
Jul 01 20:56:09.821129 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:09.821111    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a\": container with ID starting with 04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a not found: ID does not exist" containerID="04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a"
Jul 01 20:56:09.821202 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.821139    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a"} err="failed to get container status \"04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a\": rpc error: code = NotFound desc = could not find container \"04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a\": container with ID starting with 04b67c1fb338dc9143a4aa4c00fa15825d2e29c3e77b4f1a0b04c85bc281b12a not found: ID does not exist"
Jul 01 20:56:09.834436 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.834415    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-67485586b-hs5ft"]
Jul 01 20:56:09.837140 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:09.837122    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-67485586b-hs5ft"]
Jul 01 20:56:10.819263 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:10.819233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-67485586b-v6pj6" event={"ID":"ce9136bd-2a16-4a9d-ba29-95f96974db4a","Type":"ContainerStarted","Data":"a687acfb0f428aa1493c1b7fb8215f182c4047e3b7241f9aa602a9e3fd300734"}
Jul 01 20:56:10.819431 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:10.819348    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:10.835434 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:10.835390    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-67485586b-v6pj6" podStartSLOduration=2.253815151 podStartE2EDuration="2.835377856s" totalImagesPullingTime="581.562705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:56:10.833941825 +0000 UTC m=+576.429828159" watchObservedRunningTime="2026-07-01 20:56:10.835377856 +0000 UTC m=+576.431264168"
Jul 01 20:56:10.965328 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:10.965288    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff06046-4bdd-495c-a458-be5653b6314a" path="/var/lib/kubelet/pods/4ff06046-4bdd-495c-a458-be5653b6314a/volumes"
Jul 01 20:56:12.894105 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:12.894075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:56:34.858199 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:34.858175    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:56:34.858609 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:34.858176    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 20:56:41.828673 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:41.828638    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-67485586b-v6pj6"
Jul 01 20:56:42.802275 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.802234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:56:42.843415 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.843385    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-6txk2"]
Jul 01 20:56:42.843779 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.843765    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff06046-4bdd-495c-a458-be5653b6314a" containerName="manager"
Jul 01 20:56:42.843779 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.843780    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff06046-4bdd-495c-a458-be5653b6314a" containerName="manager"
Jul 01 20:56:42.843858 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.843844    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff06046-4bdd-495c-a458-be5653b6314a" containerName="manager"
Jul 01 20:56:42.845755 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.845740    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:42.848108 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.848091    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-qwcqr\""
Jul 01 20:56:42.848474 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.848457    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 01 20:56:42.863108 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.863063    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-6txk2"]
Jul 01 20:56:42.867972 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.867947    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-ldtzq"]
Jul 01 20:56:42.870185 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.870171    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:42.872413 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.872394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 01 20:56:42.872565 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.872548    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-6jhjn\""
Jul 01 20:56:42.880373 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.880348    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-ldtzq"]
Jul 01 20:56:42.940844 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.940822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v24js\" (UniqueName: \"kubernetes.io/projected/838c590a-c40a-407d-99c4-f3a2c03e1dd5-kube-api-access-v24js\") pod \"model-serving-api-fd65d7d6-6txk2\" (UID: \"838c590a-c40a-407d-99c4-f3a2c03e1dd5\") " pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:42.940951 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.940852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzsrs\" (UniqueName: \"kubernetes.io/projected/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-kube-api-access-lzsrs\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:42.940951 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.940880    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838c590a-c40a-407d-99c4-f3a2c03e1dd5-tls-certs\") pod \"model-serving-api-fd65d7d6-6txk2\" (UID: \"838c590a-c40a-407d-99c4-f3a2c03e1dd5\") " pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:42.941055 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:42.940987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:43.041890 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.041863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:43.042038 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.041931    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v24js\" (UniqueName: \"kubernetes.io/projected/838c590a-c40a-407d-99c4-f3a2c03e1dd5-kube-api-access-v24js\") pod \"model-serving-api-fd65d7d6-6txk2\" (UID: \"838c590a-c40a-407d-99c4-f3a2c03e1dd5\") " pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:43.042038 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.041972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzsrs\" (UniqueName: \"kubernetes.io/projected/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-kube-api-access-lzsrs\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:43.042175 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.042070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838c590a-c40a-407d-99c4-f3a2c03e1dd5-tls-certs\") pod \"model-serving-api-fd65d7d6-6txk2\" (UID: \"838c590a-c40a-407d-99c4-f3a2c03e1dd5\") " pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:43.042175 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:43.042152    2569 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 01 20:56:43.042278 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:43.042229    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert podName:9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b nodeName:}" failed. No retries permitted until 2026-07-01 20:56:43.542210293 +0000 UTC m=+609.138096598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert") pod "odh-model-controller-84b54b7f97-ldtzq" (UID: "9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b") : secret "odh-model-controller-webhook-cert" not found
Jul 01 20:56:43.042278 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:43.042252    2569 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 01 20:56:43.042360 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:43.042305    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838c590a-c40a-407d-99c4-f3a2c03e1dd5-tls-certs podName:838c590a-c40a-407d-99c4-f3a2c03e1dd5 nodeName:}" failed. No retries permitted until 2026-07-01 20:56:43.542293786 +0000 UTC m=+609.138180078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/838c590a-c40a-407d-99c4-f3a2c03e1dd5-tls-certs") pod "model-serving-api-fd65d7d6-6txk2" (UID: "838c590a-c40a-407d-99c4-f3a2c03e1dd5") : secret "model-serving-api-tls" not found
Jul 01 20:56:43.053615 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.053551    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzsrs\" (UniqueName: \"kubernetes.io/projected/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-kube-api-access-lzsrs\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:43.053758 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.053737    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v24js\" (UniqueName: \"kubernetes.io/projected/838c590a-c40a-407d-99c4-f3a2c03e1dd5-kube-api-access-v24js\") pod \"model-serving-api-fd65d7d6-6txk2\" (UID: \"838c590a-c40a-407d-99c4-f3a2c03e1dd5\") " pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:43.545681 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.545651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838c590a-c40a-407d-99c4-f3a2c03e1dd5-tls-certs\") pod \"model-serving-api-fd65d7d6-6txk2\" (UID: \"838c590a-c40a-407d-99c4-f3a2c03e1dd5\") " pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:43.545842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.545707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:43.545842 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:43.545795    2569 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 01 20:56:43.545916 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:56:43.545851    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert podName:9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b nodeName:}" failed. No retries permitted until 2026-07-01 20:56:44.545837285 +0000 UTC m=+610.141723577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert") pod "odh-model-controller-84b54b7f97-ldtzq" (UID: "9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b") : secret "odh-model-controller-webhook-cert" not found
Jul 01 20:56:43.547912 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.547884    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838c590a-c40a-407d-99c4-f3a2c03e1dd5-tls-certs\") pod \"model-serving-api-fd65d7d6-6txk2\" (UID: \"838c590a-c40a-407d-99c4-f3a2c03e1dd5\") " pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:43.756529 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.756502    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:43.884877 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.884854    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-6txk2"]
Jul 01 20:56:43.886267 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:56:43.886245    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838c590a_c40a_407d_99c4_f3a2c03e1dd5.slice/crio-5b21a687f0695844418b4ff3b4c6d88b8055466c8ef1e57a44fdbeadafe308a6 WatchSource:0}: Error finding container 5b21a687f0695844418b4ff3b4c6d88b8055466c8ef1e57a44fdbeadafe308a6: Status 404 returned error can't find the container with id 5b21a687f0695844418b4ff3b4c6d88b8055466c8ef1e57a44fdbeadafe308a6
Jul 01 20:56:43.888096 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.888081    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 20:56:43.983757 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:43.983729    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-6txk2" event={"ID":"838c590a-c40a-407d-99c4-f3a2c03e1dd5","Type":"ContainerStarted","Data":"5b21a687f0695844418b4ff3b4c6d88b8055466c8ef1e57a44fdbeadafe308a6"}
Jul 01 20:56:44.171476 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:44.171451    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:56:44.552141 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:44.552052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:44.554962 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:44.554941    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b-cert\") pod \"odh-model-controller-84b54b7f97-ldtzq\" (UID: \"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b\") " pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:44.682450 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:44.682414    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:44.902114 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:44.902090    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-ldtzq"]
Jul 01 20:56:44.903929 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:56:44.903906    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f778b5d_4bbf_481f_8e2f_cdb6e5311e8b.slice/crio-873a5ab261118661d730cd3b1c1186d7eebff2f1ce277f01e807f737bc5a1621 WatchSource:0}: Error finding container 873a5ab261118661d730cd3b1c1186d7eebff2f1ce277f01e807f737bc5a1621: Status 404 returned error can't find the container with id 873a5ab261118661d730cd3b1c1186d7eebff2f1ce277f01e807f737bc5a1621
Jul 01 20:56:44.991030 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:44.990980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-ldtzq" event={"ID":"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b","Type":"ContainerStarted","Data":"873a5ab261118661d730cd3b1c1186d7eebff2f1ce277f01e807f737bc5a1621"}
Jul 01 20:56:46.000338 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:46.000265    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-6txk2" event={"ID":"838c590a-c40a-407d-99c4-f3a2c03e1dd5","Type":"ContainerStarted","Data":"a6e56828d524bf3b71c9af28bf0b7c75eafee30bbf0c569a94acafd2a68d635a"}
Jul 01 20:56:46.000338 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:46.000332    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:56:46.018203 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:46.018151    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-6txk2" podStartSLOduration=2.394796564 podStartE2EDuration="4.018132711s" totalImagesPullingTime="1.623336147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:56:46.016289819 +0000 UTC m=+611.612176134" watchObservedRunningTime="2026-07-01 20:56:46.018132711 +0000 UTC m=+611.614019024"
Jul 01 20:56:49.021163 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:49.021128    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-ldtzq" event={"ID":"9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b","Type":"ContainerStarted","Data":"dba78c10077df26e0b56b11adba0ad503c4cf656b77e9ffce9941265560b509e"}
Jul 01 20:56:49.021610 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:49.021197    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:56:49.040968 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:49.040910    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-ldtzq" podStartSLOduration=3.868047574 podStartE2EDuration="7.040892526s" totalImagesPullingTime="3.172844952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:56:49.038525047 +0000 UTC m=+614.634411360" watchObservedRunningTime="2026-07-01 20:56:49.040892526 +0000 UTC m=+614.636778841"
Jul 01 20:56:57.012135 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:56:57.012063    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-6txk2"
Jul 01 20:57:00.028663 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:57:00.028633    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-ldtzq"
Jul 01 20:57:31.000878 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:57:31.000847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:57:39.907458 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:57:39.907380    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:57:51.560125 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:57:51.560089    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:19.237870 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:19.237837    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:19.342038 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:19.341981    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:23.309153 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:23.309115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:23.410228 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:23.410196    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:31.424033 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.423933    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"]
Jul 01 20:58:31.427473 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.427454    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.430113 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.430084    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 01 20:58:31.430113 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.430084    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 20:58:31.430294 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.430130    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-z4bhc\""
Jul 01 20:58:31.430294 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.430145    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 20:58:31.443316 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.443293    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"]
Jul 01 20:58:31.455880 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.455848    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:31.553710 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.553679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.553833 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.553716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8265486-1673-49d6-84d3-0c05c2d31299-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.553833 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.553736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8v6d\" (UniqueName: \"kubernetes.io/projected/c8265486-1673-49d6-84d3-0c05c2d31299-kube-api-access-p8v6d\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.553833 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.553827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.553968 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.553862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8265486-1673-49d6-84d3-0c05c2d31299-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.553968 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.553911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.553968 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.553935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8265486-1673-49d6-84d3-0c05c2d31299-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.554141 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.554023    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.554141 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.554067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.554844 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.554821    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:31.654450 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654450 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8265486-1673-49d6-84d3-0c05c2d31299-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654625 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654465    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8v6d\" (UniqueName: \"kubernetes.io/projected/c8265486-1673-49d6-84d3-0c05c2d31299-kube-api-access-p8v6d\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654625 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654625 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654583    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8265486-1673-49d6-84d3-0c05c2d31299-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654789 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654789 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654667    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8265486-1673-49d6-84d3-0c05c2d31299-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654789 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654695    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.654789 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654730    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.655017 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.654815    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.655573 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.655094    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.655573 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.655180    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.655573 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.655301    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.655573 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.655514    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8265486-1673-49d6-84d3-0c05c2d31299-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.656807 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.656781    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8265486-1673-49d6-84d3-0c05c2d31299-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.657115 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.657095    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8265486-1673-49d6-84d3-0c05c2d31299-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.662796 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.662770    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8265486-1673-49d6-84d3-0c05c2d31299-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.662893 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.662837    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8v6d\" (UniqueName: \"kubernetes.io/projected/c8265486-1673-49d6-84d3-0c05c2d31299-kube-api-access-p8v6d\") pod \"router-gateway-1-openshift-default-54c47cdfc7-ss4x6\" (UID: \"c8265486-1673-49d6-84d3-0c05c2d31299\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.750602 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.750546    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:31.888492 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:31.888460    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"]
Jul 01 20:58:31.889780 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:58:31.889749    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8265486_1673_49d6_84d3_0c05c2d31299.slice/crio-48eb7d913103b561f32b1f5265fee16234e5fb4a5cec335b4b6a165582e73a05 WatchSource:0}: Error finding container 48eb7d913103b561f32b1f5265fee16234e5fb4a5cec335b4b6a165582e73a05: Status 404 returned error can't find the container with id 48eb7d913103b561f32b1f5265fee16234e5fb4a5cec335b4b6a165582e73a05
Jul 01 20:58:32.563563 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:32.563532    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" event={"ID":"c8265486-1673-49d6-84d3-0c05c2d31299","Type":"ContainerStarted","Data":"48eb7d913103b561f32b1f5265fee16234e5fb4a5cec335b4b6a165582e73a05"}
Jul 01 20:58:35.014969 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:35.014934    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:58:35.015335 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:35.015018    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:58:35.015335 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:35.015051    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:58:35.292809 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:35.292774    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:35.580847 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:35.580765    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" event={"ID":"c8265486-1673-49d6-84d3-0c05c2d31299","Type":"ContainerStarted","Data":"f81ab45d968c81e10a78fef7b735e8f99ccc68abc6e729a1bcac472169be60c4"}
Jul 01 20:58:35.601933 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:35.601889    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" podStartSLOduration=1.478988534 podStartE2EDuration="4.601875068s" totalImagesPullingTime="3.122886534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:58:35.599616016 +0000 UTC m=+721.195502331" watchObservedRunningTime="2026-07-01 20:58:35.601875068 +0000 UTC m=+721.197761383"
Jul 01 20:58:35.750659 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:35.750601    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:36.756120 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:36.756093    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:37.591238 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:37.591209    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:37.592062 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:37.592045    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:58:43.002809 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.002776    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"]
Jul 01 20:58:43.006470 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.006451    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.008953 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.008931    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 20:58:43.009673 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.009656    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 20:58:43.009747 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.009715    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-kserve-self-signed-certs\""
Jul 01 20:58:43.017132 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.017112    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"]
Jul 01 20:58:43.018844 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.018822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:43.141325 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.141296    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-tmp-dir\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.141325 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.141327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0faf7b2-800e-40d7-b618-93c62dd257bb-tls-certs\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.141531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.141359    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.141531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.141426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-model-cache\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.141531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.141458    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59b7q\" (UniqueName: \"kubernetes.io/projected/f0faf7b2-800e-40d7-b618-93c62dd257bb-kube-api-access-59b7q\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.141531 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.141496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-home\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.141751 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.141582    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-dshm\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.242811 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.242781    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-model-cache\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.242953 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.242820    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59b7q\" (UniqueName: \"kubernetes.io/projected/f0faf7b2-800e-40d7-b618-93c62dd257bb-kube-api-access-59b7q\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.242953 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.242865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-home\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.242953 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.242927    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-dshm\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.243158 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.242961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-tmp-dir\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.243158 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.242984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0faf7b2-800e-40d7-b618-93c62dd257bb-tls-certs\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.243158 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.243031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.243311 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.243245    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-model-cache\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.243495 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.243470    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-home\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.243551 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.243515    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-tmp-dir\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.243606 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.243557    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.245237 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.245218    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-dshm\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.245487 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.245468    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0faf7b2-800e-40d7-b618-93c62dd257bb-tls-certs\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.252718 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.252687    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59b7q\" (UniqueName: \"kubernetes.io/projected/f0faf7b2-800e-40d7-b618-93c62dd257bb-kube-api-access-59b7q\") pod \"precise-prefix-cache-test-kserve-7f56466b78-5ms96\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.319197 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.319143    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:58:43.456731 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.456710    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"]
Jul 01 20:58:43.458630 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:58:43.458606    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0faf7b2_800e_40d7_b618_93c62dd257bb.slice/crio-bacc0f1103fd9dad4dc7d8e905c2291acf3a1ea9a8d6e3d5ec14b2f105e9f06e WatchSource:0}: Error finding container bacc0f1103fd9dad4dc7d8e905c2291acf3a1ea9a8d6e3d5ec14b2f105e9f06e: Status 404 returned error can't find the container with id bacc0f1103fd9dad4dc7d8e905c2291acf3a1ea9a8d6e3d5ec14b2f105e9f06e
Jul 01 20:58:43.565049 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.565021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:43.620842 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:43.620814    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" event={"ID":"f0faf7b2-800e-40d7-b618-93c62dd257bb","Type":"ContainerStarted","Data":"bacc0f1103fd9dad4dc7d8e905c2291acf3a1ea9a8d6e3d5ec14b2f105e9f06e"}
Jul 01 20:58:47.647854 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:47.647820    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" event={"ID":"f0faf7b2-800e-40d7-b618-93c62dd257bb","Type":"ContainerStarted","Data":"c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d"}
Jul 01 20:58:52.863288 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:52.863243    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"]
Jul 01 20:58:52.872926 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:52.872901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:52.875643 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:52.875617    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs\""
Jul 01 20:58:52.876392 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:52.876372    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"]
Jul 01 20:58:52.895791 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:52.895755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:58:53.032773 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.032742    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.032918 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.032775    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrbh\" (UniqueName: \"kubernetes.io/projected/020e0823-45fd-4a09-8bcf-da6af3d291a8-kube-api-access-8zrbh\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.032918 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.032808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.032918 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.032882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.033061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.032927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/020e0823-45fd-4a09-8bcf-da6af3d291a8-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.033061 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.032959    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134124 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134058    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134124 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134099    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134318 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134130    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/020e0823-45fd-4a09-8bcf-da6af3d291a8-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134318 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134318 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134296    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134483 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134337    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrbh\" (UniqueName: \"kubernetes.io/projected/020e0823-45fd-4a09-8bcf-da6af3d291a8-kube-api-access-8zrbh\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134683 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134654    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134807 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.134807 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.134777    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.136899 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.136877    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.137053 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.137037    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/020e0823-45fd-4a09-8bcf-da6af3d291a8-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.144632 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.144531    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrbh\" (UniqueName: \"kubernetes.io/projected/020e0823-45fd-4a09-8bcf-da6af3d291a8-kube-api-access-8zrbh\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.184915 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.184895    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:58:53.331983 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.331757    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"]
Jul 01 20:58:53.337015 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:58:53.336953    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020e0823_45fd_4a09_8bcf_da6af3d291a8.slice/crio-25fc10e35081c6d407a8f5a056fe5ddfc984297981970a4d2783f91869bf4afc WatchSource:0}: Error finding container 25fc10e35081c6d407a8f5a056fe5ddfc984297981970a4d2783f91869bf4afc: Status 404 returned error can't find the container with id 25fc10e35081c6d407a8f5a056fe5ddfc984297981970a4d2783f91869bf4afc
Jul 01 20:58:53.688082 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:53.688036    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt" event={"ID":"020e0823-45fd-4a09-8bcf-da6af3d291a8","Type":"ContainerStarted","Data":"25fc10e35081c6d407a8f5a056fe5ddfc984297981970a4d2783f91869bf4afc"}
Jul 01 20:58:55.700588 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:55.700550    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt" event={"ID":"020e0823-45fd-4a09-8bcf-da6af3d291a8","Type":"ContainerStarted","Data":"1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb"}
Jul 01 20:58:55.718539 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:55.718480    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt" podStartSLOduration=2.295318807 podStartE2EDuration="3.718460333s" totalImagesPullingTime="1.423141526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:58:55.717572636 +0000 UTC m=+741.313458946" watchObservedRunningTime="2026-07-01 20:58:55.718460333 +0000 UTC m=+741.314346646"
Jul 01 20:58:56.186080 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:58:56.186049    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:59:01.743291 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:01.743252    2569 generic.go:356] "Generic (PLEG): container finished" podID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerID="c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d" exitCode=0
Jul 01 20:59:01.743769 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:01.743311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" event={"ID":"f0faf7b2-800e-40d7-b618-93c62dd257bb","Type":"ContainerDied","Data":"c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d"}
Jul 01 20:59:02.753370 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:02.753335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" event={"ID":"f0faf7b2-800e-40d7-b618-93c62dd257bb","Type":"ContainerStarted","Data":"0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342"}
Jul 01 20:59:03.186054 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.186026    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:59:03.198680 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.198654    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:59:03.216034 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.215967    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" podStartSLOduration=3.65266475 podStartE2EDuration="21.21594945s" totalImagesPullingTime="3.563410025s" totalInitContainerRuntime="13.999874675s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:59:02.771505576 +0000 UTC m=+748.367391889" watchObservedRunningTime="2026-07-01 20:59:03.21594945 +0000 UTC m=+748.811835765"
Jul 01 20:59:03.320045 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.320015    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:59:03.320159 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.320063    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:59:03.332602 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.332581    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:59:03.760925 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.760887    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8265486-1673-49d6-84d3-0c05c2d31299" containerID="f81ab45d968c81e10a78fef7b735e8f99ccc68abc6e729a1bcac472169be60c4" exitCode=0
Jul 01 20:59:03.761409 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.760927    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" event={"ID":"c8265486-1673-49d6-84d3-0c05c2d31299","Type":"ContainerDied","Data":"f81ab45d968c81e10a78fef7b735e8f99ccc68abc6e729a1bcac472169be60c4"}
Jul 01 20:59:03.761801 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.761777    2569 scope.go:117] "RemoveContainer" containerID="f81ab45d968c81e10a78fef7b735e8f99ccc68abc6e729a1bcac472169be60c4"
Jul 01 20:59:03.762922 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.762892    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:59:03.763084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.762975    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:59:03.763084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.763034    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 20:59:03.773254 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.773236    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:59:03.774111 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:03.774092    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 20:59:04.768804 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:04.768767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" event={"ID":"c8265486-1673-49d6-84d3-0c05c2d31299","Type":"ContainerStarted","Data":"cb4e739cbab8ab908d961d18c80f26dbffb54fcc8b9513db2b02c8e36f4b8eed"}
Jul 01 20:59:05.751348 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:05.751310    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:59:05.752543 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:05.752514    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" podUID="c8265486-1673-49d6-84d3-0c05c2d31299" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 01 20:59:06.751642 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:06.751592    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" podUID="c8265486-1673-49d6-84d3-0c05c2d31299" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 01 20:59:07.591433 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:07.591398    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:59:07.751099 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:07.751060    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" podUID="c8265486-1673-49d6-84d3-0c05c2d31299" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 01 20:59:08.153639 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:08.153604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:59:08.751327 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:08.751282    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" podUID="c8265486-1673-49d6-84d3-0c05c2d31299" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 01 20:59:09.551884 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:09.551852    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"]
Jul 01 20:59:09.581392 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:09.581364    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:59:09.751214 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:09.751176    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6" podUID="c8265486-1673-49d6-84d3-0c05c2d31299" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 01 20:59:10.755191 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:10.755160    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:59:10.756267 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:10.756249    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6"
Jul 01 20:59:24.572345 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.572297    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt" podUID="020e0823-45fd-4a09-8bcf-da6af3d291a8" containerName="main" containerID="cri-o://1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb" gracePeriod=45
Jul 01 20:59:24.817449 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.817427    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:59:24.881101 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.881076    2569 generic.go:356] "Generic (PLEG): container finished" podID="020e0823-45fd-4a09-8bcf-da6af3d291a8" containerID="1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb" exitCode=0
Jul 01 20:59:24.881215 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.881111    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"
Jul 01 20:59:24.881215 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.881157    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt" event={"ID":"020e0823-45fd-4a09-8bcf-da6af3d291a8","Type":"ContainerDied","Data":"1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb"}
Jul 01 20:59:24.881315 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.881227    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt" event={"ID":"020e0823-45fd-4a09-8bcf-da6af3d291a8","Type":"ContainerDied","Data":"25fc10e35081c6d407a8f5a056fe5ddfc984297981970a4d2783f91869bf4afc"}
Jul 01 20:59:24.881315 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.881250    2569 scope.go:117] "RemoveContainer" containerID="1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb"
Jul 01 20:59:24.889479 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.889462    2569 scope.go:117] "RemoveContainer" containerID="1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb"
Jul 01 20:59:24.889724 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:24.889703    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb\": container with ID starting with 1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb not found: ID does not exist" containerID="1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb"
Jul 01 20:59:24.889773 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.889737    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb"} err="failed to get container status \"1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb\": rpc error: code = NotFound desc = could not find container \"1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb\": container with ID starting with 1addcc6b48d1efdbfaa6e46f492a818e482dbf9f3dfae6b172df277c1bec31eb not found: ID does not exist"
Jul 01 20:59:24.903491 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903470    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zrbh\" (UniqueName: \"kubernetes.io/projected/020e0823-45fd-4a09-8bcf-da6af3d291a8-kube-api-access-8zrbh\") pod \"020e0823-45fd-4a09-8bcf-da6af3d291a8\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") "
Jul 01 20:59:24.903578 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-tmp-dir\") pod \"020e0823-45fd-4a09-8bcf-da6af3d291a8\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") "
Jul 01 20:59:24.903578 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903518    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-home\") pod \"020e0823-45fd-4a09-8bcf-da6af3d291a8\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") "
Jul 01 20:59:24.903578 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903551    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-model-cache\") pod \"020e0823-45fd-4a09-8bcf-da6af3d291a8\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") "
Jul 01 20:59:24.903712 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903611    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-dshm\") pod \"020e0823-45fd-4a09-8bcf-da6af3d291a8\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") "
Jul 01 20:59:24.903712 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903634    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/020e0823-45fd-4a09-8bcf-da6af3d291a8-tls-certs\") pod \"020e0823-45fd-4a09-8bcf-da6af3d291a8\" (UID: \"020e0823-45fd-4a09-8bcf-da6af3d291a8\") "
Jul 01 20:59:24.903819 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903779    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-home" (OuterVolumeSpecName: "home") pod "020e0823-45fd-4a09-8bcf-da6af3d291a8" (UID: "020e0823-45fd-4a09-8bcf-da6af3d291a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:24.903819 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903767    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "020e0823-45fd-4a09-8bcf-da6af3d291a8" (UID: "020e0823-45fd-4a09-8bcf-da6af3d291a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:24.903933 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903827    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "020e0823-45fd-4a09-8bcf-da6af3d291a8" (UID: "020e0823-45fd-4a09-8bcf-da6af3d291a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:24.903933 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903917    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-tmp-dir\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:24.904059 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903934    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-home\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:24.904059 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.903943    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-model-cache\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:24.905660 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.905635    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020e0823-45fd-4a09-8bcf-da6af3d291a8-kube-api-access-8zrbh" (OuterVolumeSpecName: "kube-api-access-8zrbh") pod "020e0823-45fd-4a09-8bcf-da6af3d291a8" (UID: "020e0823-45fd-4a09-8bcf-da6af3d291a8"). InnerVolumeSpecName "kube-api-access-8zrbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:59:24.905660 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.905645    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020e0823-45fd-4a09-8bcf-da6af3d291a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "020e0823-45fd-4a09-8bcf-da6af3d291a8" (UID: "020e0823-45fd-4a09-8bcf-da6af3d291a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:59:24.905790 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:24.905637    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-dshm" (OuterVolumeSpecName: "dshm") pod "020e0823-45fd-4a09-8bcf-da6af3d291a8" (UID: "020e0823-45fd-4a09-8bcf-da6af3d291a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:25.004801 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:25.004779    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/020e0823-45fd-4a09-8bcf-da6af3d291a8-dshm\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:25.004801 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:25.004798    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/020e0823-45fd-4a09-8bcf-da6af3d291a8-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:25.004975 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:25.004809    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zrbh\" (UniqueName: \"kubernetes.io/projected/020e0823-45fd-4a09-8bcf-da6af3d291a8-kube-api-access-8zrbh\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:25.197961 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:25.197883    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"]
Jul 01 20:59:25.199986 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:25.199965    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt"]
Jul 01 20:59:25.761881 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:25.761845    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt" podUID="020e0823-45fd-4a09-8bcf-da6af3d291a8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 01 20:59:26.965140 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:26.965111    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="020e0823-45fd-4a09-8bcf-da6af3d291a8" path="/var/lib/kubelet/pods/020e0823-45fd-4a09-8bcf-da6af3d291a8/volumes"
Jul 01 20:59:28.478125 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.478095    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"]
Jul 01 20:59:28.478683 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.478663    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020e0823-45fd-4a09-8bcf-da6af3d291a8" containerName="main"
Jul 01 20:59:28.478772 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.478686    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="020e0823-45fd-4a09-8bcf-da6af3d291a8" containerName="main"
Jul 01 20:59:28.478827 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.478796    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="020e0823-45fd-4a09-8bcf-da6af3d291a8" containerName="main"
Jul 01 20:59:28.481812 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.481790    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.484264 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.484245    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 01 20:59:28.487920 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.487895    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"]
Jul 01 20:59:28.500466 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.500446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:59:28.534104 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.534080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqpn2\" (UniqueName: \"kubernetes.io/projected/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-kube-api-access-fqpn2\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.534189 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.534134    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.534244 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.534225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.534286 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.534268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.534320 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.534301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.534355 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.534335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.634967 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.634940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqpn2\" (UniqueName: \"kubernetes.io/projected/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-kube-api-access-fqpn2\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635088 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635088 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635055    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635184 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635184 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635184 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635355 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635336    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635441 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635419    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.635500 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.635447    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.637346 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.637328    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.637643 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.637622    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.642325 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.642306    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqpn2\" (UniqueName: \"kubernetes.io/projected/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-kube-api-access-fqpn2\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:28.793010 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:28.792925    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:29.143023 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:29.139522    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"]
Jul 01 20:59:29.145250 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:59:29.145217    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1aa9f51_9e67_4b6a_958f_d10ab26fe045.slice/crio-980549b1d8836c16fe7df86d36ddcb5409fccb752673eb267a08be86e32e1772 WatchSource:0}: Error finding container 980549b1d8836c16fe7df86d36ddcb5409fccb752673eb267a08be86e32e1772: Status 404 returned error can't find the container with id 980549b1d8836c16fe7df86d36ddcb5409fccb752673eb267a08be86e32e1772
Jul 01 20:59:29.913370 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:29.913336    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" event={"ID":"f1aa9f51-9e67-4b6a-958f-d10ab26fe045","Type":"ContainerStarted","Data":"180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d"}
Jul 01 20:59:29.913814 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:29.913385    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" event={"ID":"f1aa9f51-9e67-4b6a-958f-d10ab26fe045","Type":"ContainerStarted","Data":"980549b1d8836c16fe7df86d36ddcb5409fccb752673eb267a08be86e32e1772"}
Jul 01 20:59:29.931645 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:29.931600    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" podStartSLOduration=1.931584452 podStartE2EDuration="1.931584452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:59:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:59:29.929902145 +0000 UTC m=+775.525788457" watchObservedRunningTime="2026-07-01 20:59:29.931584452 +0000 UTC m=+775.527470764"
Jul 01 20:59:30.793536 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:30.793488    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:30.797428 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:30.797400    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"]
Jul 01 20:59:30.814858 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:30.814830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:59:31.059979 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:31.059906    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:31.059979 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:31.059971    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs podName:f1aa9f51-9e67-4b6a-958f-d10ab26fe045 nodeName:}" failed. No retries permitted until 2026-07-01 20:59:31.559953553 +0000 UTC m=+777.155839843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:31.565159 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:31.565130    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:31.565312 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:31.565197    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs podName:f1aa9f51-9e67-4b6a-958f-d10ab26fe045 nodeName:}" failed. No retries permitted until 2026-07-01 20:59:32.565182887 +0000 UTC m=+778.161069179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:32.573430 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:32.573398    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:32.573807 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:32.573474    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs podName:f1aa9f51-9e67-4b6a-958f-d10ab26fe045 nodeName:}" failed. No retries permitted until 2026-07-01 20:59:34.573460295 +0000 UTC m=+780.169346585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:34.589187 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:34.589157    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:34.589553 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:34.589220    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs podName:f1aa9f51-9e67-4b6a-958f-d10ab26fe045 nodeName:}" failed. No retries permitted until 2026-07-01 20:59:38.589206061 +0000 UTC m=+784.185092352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:38.619132 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:38.619101    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:38.619498 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:38.619175    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs podName:f1aa9f51-9e67-4b6a-958f-d10ab26fe045 nodeName:}" failed. No retries permitted until 2026-07-01 20:59:46.619160767 +0000 UTC m=+792.215047058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:43.320681 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.320648    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:59:43.542811 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.542778    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"]
Jul 01 20:59:43.546353 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.546325    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.548653 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.548630    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"auth-enabled-test-kserve-self-signed-certs\""
Jul 01 20:59:43.549042 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.548987    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"auth-enabled-test-epp-sa-dockercfg-lm4dv\""
Jul 01 20:59:43.559184 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.559163    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"]
Jul 01 20:59:43.582949 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.582875    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 20:59:43.659847 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.659817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tokenizer-uds\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.659957 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.659852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n29k\" (UniqueName: \"kubernetes.io/projected/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kube-api-access-7n29k\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.659957 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.659883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kserve-provision-location\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.660087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.660069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.760521 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.760495    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.760642 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.760541    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tokenizer-uds\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.760642 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.760559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n29k\" (UniqueName: \"kubernetes.io/projected/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kube-api-access-7n29k\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.760642 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.760577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kserve-provision-location\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.760982 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.760962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kserve-provision-location\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.761106 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.760963    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tokenizer-uds\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.763211 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.763178    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.769057 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.769034    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n29k\" (UniqueName: \"kubernetes.io/projected/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kube-api-access-7n29k\") pod \"auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") " pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.856449 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.856425    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:43.989084 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:43.989062    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"]
Jul 01 20:59:43.990471 ip-10-0-132-117 kubenswrapper[2569]: W0701 20:59:43.990438    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6957fdbf_3eeb_41c5_aef0_78e1d62aab90.slice/crio-fae9e1986eb671165b19592c47eca766fc9b1b8f486d93d56d1a5cf0a04a57ac WatchSource:0}: Error finding container fae9e1986eb671165b19592c47eca766fc9b1b8f486d93d56d1a5cf0a04a57ac: Status 404 returned error can't find the container with id fae9e1986eb671165b19592c47eca766fc9b1b8f486d93d56d1a5cf0a04a57ac
Jul 01 20:59:44.998251 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:44.998168    2569 generic.go:356] "Generic (PLEG): container finished" podID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerID="daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230" exitCode=0
Jul 01 20:59:44.998605 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:44.998257    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" event={"ID":"6957fdbf-3eeb-41c5-aef0-78e1d62aab90","Type":"ContainerDied","Data":"daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230"}
Jul 01 20:59:44.998605 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:44.998307    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" event={"ID":"6957fdbf-3eeb-41c5-aef0-78e1d62aab90","Type":"ContainerStarted","Data":"fae9e1986eb671165b19592c47eca766fc9b1b8f486d93d56d1a5cf0a04a57ac"}
Jul 01 20:59:46.688734 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:46.688702    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:46.689161 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:46.688767    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs podName:f1aa9f51-9e67-4b6a-958f-d10ab26fe045 nodeName:}" failed. No retries permitted until 2026-07-01 21:00:02.688752994 +0000 UTC m=+808.284639285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 01 20:59:46.951074 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:46.950979    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" podUID="f1aa9f51-9e67-4b6a-958f-d10ab26fe045" containerName="main" containerID="cri-o://180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d" gracePeriod=45
Jul 01 20:59:47.009415 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.009383    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" event={"ID":"6957fdbf-3eeb-41c5-aef0-78e1d62aab90","Type":"ContainerStarted","Data":"67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a"}
Jul 01 20:59:47.009551 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.009440    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 20:59:47.034328 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.034280    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" podStartSLOduration=2.362756888 podStartE2EDuration="4.034265662s" totalImagesPullingTime="1.013542241s" totalInitContainerRuntime="657.966533ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:59:47.0318235 +0000 UTC m=+792.627709825" watchObservedRunningTime="2026-07-01 20:59:47.034265662 +0000 UTC m=+792.630151975"
Jul 01 20:59:47.205787 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.205720    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:47.292372 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292335    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqpn2\" (UniqueName: \"kubernetes.io/projected/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-kube-api-access-fqpn2\") pod \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") "
Jul 01 20:59:47.292528 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292397    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-home\") pod \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") "
Jul 01 20:59:47.292528 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292427    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-model-cache\") pod \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") "
Jul 01 20:59:47.292528 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292450    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-dshm\") pod \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") "
Jul 01 20:59:47.292528 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292486    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs\") pod \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") "
Jul 01 20:59:47.292528 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292527    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tmp-dir\") pod \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\" (UID: \"f1aa9f51-9e67-4b6a-958f-d10ab26fe045\") "
Jul 01 20:59:47.292787 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292712    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-home" (OuterVolumeSpecName: "home") pod "f1aa9f51-9e67-4b6a-958f-d10ab26fe045" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:47.292787 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292727    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-model-cache" (OuterVolumeSpecName: "model-cache") pod "f1aa9f51-9e67-4b6a-958f-d10ab26fe045" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:47.292899 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.292870    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f1aa9f51-9e67-4b6a-958f-d10ab26fe045" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:47.294479 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.294453    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-kube-api-access-fqpn2" (OuterVolumeSpecName: "kube-api-access-fqpn2") pod "f1aa9f51-9e67-4b6a-958f-d10ab26fe045" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045"). InnerVolumeSpecName "kube-api-access-fqpn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:59:47.294548 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.294508    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f1aa9f51-9e67-4b6a-958f-d10ab26fe045" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:59:47.294548 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.294532    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-dshm" (OuterVolumeSpecName: "dshm") pod "f1aa9f51-9e67-4b6a-958f-d10ab26fe045" (UID: "f1aa9f51-9e67-4b6a-958f-d10ab26fe045"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:59:47.393721 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.393697    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqpn2\" (UniqueName: \"kubernetes.io/projected/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-kube-api-access-fqpn2\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:47.393721 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.393718    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-home\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:47.393840 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.393728    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-model-cache\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:47.393840 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.393736    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-dshm\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:47.393840 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.393744    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:47.393840 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:47.393751    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1aa9f51-9e67-4b6a-958f-d10ab26fe045-tmp-dir\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 20:59:48.017037 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.016976    2569 generic.go:356] "Generic (PLEG): container finished" podID="f1aa9f51-9e67-4b6a-958f-d10ab26fe045" containerID="180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d" exitCode=0
Jul 01 20:59:48.017390 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.017053    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"
Jul 01 20:59:48.017390 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.017060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" event={"ID":"f1aa9f51-9e67-4b6a-958f-d10ab26fe045","Type":"ContainerDied","Data":"180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d"}
Jul 01 20:59:48.017390 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.017109    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q" event={"ID":"f1aa9f51-9e67-4b6a-958f-d10ab26fe045","Type":"ContainerDied","Data":"980549b1d8836c16fe7df86d36ddcb5409fccb752673eb267a08be86e32e1772"}
Jul 01 20:59:48.017390 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.017136    2569 scope.go:117] "RemoveContainer" containerID="180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d"
Jul 01 20:59:48.026749 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.026732    2569 scope.go:117] "RemoveContainer" containerID="180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d"
Jul 01 20:59:48.027023 ip-10-0-132-117 kubenswrapper[2569]: E0701 20:59:48.026977    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d\": container with ID starting with 180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d not found: ID does not exist" containerID="180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d"
Jul 01 20:59:48.027087 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.027022    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d"} err="failed to get container status \"180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d\": rpc error: code = NotFound desc = could not find container \"180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d\": container with ID starting with 180dfe0d077c18711bda13e3182b0e5447abb48878485d0e81c37cbfb99b6e4d not found: ID does not exist"
Jul 01 20:59:48.038915 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.038896    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"]
Jul 01 20:59:48.043503 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.043481    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q"]
Jul 01 20:59:48.965286 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:48.965249    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1aa9f51-9e67-4b6a-958f-d10ab26fe045" path="/var/lib/kubelet/pods/f1aa9f51-9e67-4b6a-958f-d10ab26fe045/volumes"
Jul 01 20:59:56.821220 ip-10-0-132-117 kubenswrapper[2569]: I0701 20:59:56.821138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:00:00.261885 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:00.261853    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"]
Jul 01 21:00:00.274084 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:00.274051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:00:00.339568 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:00.339514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:00:15.285370 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.285317    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" podUID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerName="main" containerID="cri-o://0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342" gracePeriod=45
Jul 01 21:00:15.541081 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.541027    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 21:00:15.613298 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613277    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-kserve-provision-location\") pod \"f0faf7b2-800e-40d7-b618-93c62dd257bb\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") "
Jul 01 21:00:15.613418 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613310    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59b7q\" (UniqueName: \"kubernetes.io/projected/f0faf7b2-800e-40d7-b618-93c62dd257bb-kube-api-access-59b7q\") pod \"f0faf7b2-800e-40d7-b618-93c62dd257bb\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") "
Jul 01 21:00:15.613418 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613330    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-tmp-dir\") pod \"f0faf7b2-800e-40d7-b618-93c62dd257bb\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") "
Jul 01 21:00:15.613418 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613371    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-model-cache\") pod \"f0faf7b2-800e-40d7-b618-93c62dd257bb\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") "
Jul 01 21:00:15.613418 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613395    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0faf7b2-800e-40d7-b618-93c62dd257bb-tls-certs\") pod \"f0faf7b2-800e-40d7-b618-93c62dd257bb\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") "
Jul 01 21:00:15.613604 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613423    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-dshm\") pod \"f0faf7b2-800e-40d7-b618-93c62dd257bb\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") "
Jul 01 21:00:15.613604 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613517    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-home\") pod \"f0faf7b2-800e-40d7-b618-93c62dd257bb\" (UID: \"f0faf7b2-800e-40d7-b618-93c62dd257bb\") "
Jul 01 21:00:15.613712 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613670    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0faf7b2-800e-40d7-b618-93c62dd257bb" (UID: "f0faf7b2-800e-40d7-b618-93c62dd257bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:00:15.613712 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613685    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0faf7b2-800e-40d7-b618-93c62dd257bb" (UID: "f0faf7b2-800e-40d7-b618-93c62dd257bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:00:15.613877 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613836    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-model-cache\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:00:15.613877 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613861    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-tmp-dir\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:00:15.613877 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.613860    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-home" (OuterVolumeSpecName: "home") pod "f0faf7b2-800e-40d7-b618-93c62dd257bb" (UID: "f0faf7b2-800e-40d7-b618-93c62dd257bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:00:15.615576 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.615549    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0faf7b2-800e-40d7-b618-93c62dd257bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0faf7b2-800e-40d7-b618-93c62dd257bb" (UID: "f0faf7b2-800e-40d7-b618-93c62dd257bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:00:15.615688 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.615596    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-dshm" (OuterVolumeSpecName: "dshm") pod "f0faf7b2-800e-40d7-b618-93c62dd257bb" (UID: "f0faf7b2-800e-40d7-b618-93c62dd257bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:00:15.615739 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.615720    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0faf7b2-800e-40d7-b618-93c62dd257bb-kube-api-access-59b7q" (OuterVolumeSpecName: "kube-api-access-59b7q") pod "f0faf7b2-800e-40d7-b618-93c62dd257bb" (UID: "f0faf7b2-800e-40d7-b618-93c62dd257bb"). InnerVolumeSpecName "kube-api-access-59b7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:00:15.666893 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.666868    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f0faf7b2-800e-40d7-b618-93c62dd257bb" (UID: "f0faf7b2-800e-40d7-b618-93c62dd257bb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:00:15.714813 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.714792    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0faf7b2-800e-40d7-b618-93c62dd257bb-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:00:15.714914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.714816    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-dshm\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:00:15.714914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.714828    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-home\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:00:15.714914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.714840    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0faf7b2-800e-40d7-b618-93c62dd257bb-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:00:15.714914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:15.714852    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59b7q\" (UniqueName: \"kubernetes.io/projected/f0faf7b2-800e-40d7-b618-93c62dd257bb-kube-api-access-59b7q\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:00:16.170102 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.170065    2569 generic.go:356] "Generic (PLEG): container finished" podID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerID="0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342" exitCode=0
Jul 01 21:00:16.170227 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.170108    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" event={"ID":"f0faf7b2-800e-40d7-b618-93c62dd257bb","Type":"ContainerDied","Data":"0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342"}
Jul 01 21:00:16.170227 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.170121    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"
Jul 01 21:00:16.170227 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.170158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96" event={"ID":"f0faf7b2-800e-40d7-b618-93c62dd257bb","Type":"ContainerDied","Data":"bacc0f1103fd9dad4dc7d8e905c2291acf3a1ea9a8d6e3d5ec14b2f105e9f06e"}
Jul 01 21:00:16.170227 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.170184    2569 scope.go:117] "RemoveContainer" containerID="0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342"
Jul 01 21:00:16.180351 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.180331    2569 scope.go:117] "RemoveContainer" containerID="c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d"
Jul 01 21:00:16.188449 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.188431    2569 scope.go:117] "RemoveContainer" containerID="0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342"
Jul 01 21:00:16.188718 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:00:16.188697    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342\": container with ID starting with 0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342 not found: ID does not exist" containerID="0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342"
Jul 01 21:00:16.188770 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.188726    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342"} err="failed to get container status \"0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342\": rpc error: code = NotFound desc = could not find container \"0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342\": container with ID starting with 0b51c57da9ef9403dfad91bedcb8093ef489c3c06dd939b6ed63dd41cc2f1342 not found: ID does not exist"
Jul 01 21:00:16.188770 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.188745    2569 scope.go:117] "RemoveContainer" containerID="c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d"
Jul 01 21:00:16.189005 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:00:16.188977    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d\": container with ID starting with c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d not found: ID does not exist" containerID="c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d"
Jul 01 21:00:16.189059 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.189012    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d"} err="failed to get container status \"c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d\": rpc error: code = NotFound desc = could not find container \"c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d\": container with ID starting with c4ff90d36e69adccd56a9ca4dd2ad4c3157d1baabecda328bc95fd029462e14d not found: ID does not exist"
Jul 01 21:00:16.192757 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.192733    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"]
Jul 01 21:00:16.196670 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.196645    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96"]
Jul 01 21:00:16.965852 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:16.965810    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0faf7b2-800e-40d7-b618-93c62dd257bb" path="/var/lib/kubelet/pods/f0faf7b2-800e-40d7-b618-93c62dd257bb/volumes"
Jul 01 21:00:18.018977 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:18.018943    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 21:00:31.565656 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:31.565620    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:00:31.784014 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:31.783939    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:00:53.907211 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:00:53.907175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:01:03.120165 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:03.120123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:01:25.251620 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:25.251587    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:01:25.691664 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:25.691628    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:01:25.750049 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:25.750018    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:01:34.896651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:34.896615    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:01:34.897488 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:34.897468    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:01:48.395645 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:48.395614    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:01:50.881575 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:50.881540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:01:53.609346 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:01:53.609311    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:02:02.957422 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:02.957382    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:02:03.025962 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:03.025926    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:02:27.896537 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:27.896504    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"]
Jul 01 21:02:27.898778 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:27.898743    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:02:27.905445 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:02:27.905409    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:02:27.905445 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:02:27.905445 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:02:27.905445 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a" cmd=["/bin/sleep","15"]
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:27.905457    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" message="" err=<
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:02:27.905468    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="main" containerID="cri-o://67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a"
Jul 01 21:02:27.905682 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:27.905500    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="main" containerID="cri-o://67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a" gracePeriod=60
Jul 01 21:02:28.018006 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:02:28.017959    2569 logging.go:55] [core] [Channel #104 SubChannel #105]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.48:9003", ServerName: "10.134.0.48:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.48:9003: connect: connection refused"
Jul 01 21:02:28.023749 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.023719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:02:28.163699 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.163679    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 21:02:28.334317 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.334279    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tls-certs\") pod \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") "
Jul 01 21:02:28.334494 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.334334    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n29k\" (UniqueName: \"kubernetes.io/projected/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kube-api-access-7n29k\") pod \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") "
Jul 01 21:02:28.334494 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.334391    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tokenizer-uds\") pod \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") "
Jul 01 21:02:28.334494 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.334463    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kserve-provision-location\") pod \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\" (UID: \"6957fdbf-3eeb-41c5-aef0-78e1d62aab90\") "
Jul 01 21:02:28.334815 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.334788    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6957fdbf-3eeb-41c5-aef0-78e1d62aab90" (UID: "6957fdbf-3eeb-41c5-aef0-78e1d62aab90"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:02:28.335413 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.335387    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6957fdbf-3eeb-41c5-aef0-78e1d62aab90" (UID: "6957fdbf-3eeb-41c5-aef0-78e1d62aab90"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:02:28.336566 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.336542    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kube-api-access-7n29k" (OuterVolumeSpecName: "kube-api-access-7n29k") pod "6957fdbf-3eeb-41c5-aef0-78e1d62aab90" (UID: "6957fdbf-3eeb-41c5-aef0-78e1d62aab90"). InnerVolumeSpecName "kube-api-access-7n29k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:02:28.336566 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.336557    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6957fdbf-3eeb-41c5-aef0-78e1d62aab90" (UID: "6957fdbf-3eeb-41c5-aef0-78e1d62aab90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:02:28.435500 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.435440    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n29k\" (UniqueName: \"kubernetes.io/projected/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kube-api-access-7n29k\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:02:28.435500 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.435463    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:02:28.435500 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.435473    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:02:28.435500 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.435482    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6957fdbf-3eeb-41c5-aef0-78e1d62aab90-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:02:28.868722 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.868689    2569 generic.go:356] "Generic (PLEG): container finished" podID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerID="67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a" exitCode=0
Jul 01 21:02:28.868884 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.868746    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"
Jul 01 21:02:28.868884 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.868765    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" event={"ID":"6957fdbf-3eeb-41c5-aef0-78e1d62aab90","Type":"ContainerDied","Data":"67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a"}
Jul 01 21:02:28.868884 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.868813    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" event={"ID":"6957fdbf-3eeb-41c5-aef0-78e1d62aab90","Type":"ContainerDied","Data":"fae9e1986eb671165b19592c47eca766fc9b1b8f486d93d56d1a5cf0a04a57ac"}
Jul 01 21:02:28.868884 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.868842    2569 scope.go:117] "RemoveContainer" containerID="67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a"
Jul 01 21:02:28.879858 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.879840    2569 scope.go:117] "RemoveContainer" containerID="daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230"
Jul 01 21:02:28.887349 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.887327    2569 scope.go:117] "RemoveContainer" containerID="67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a"
Jul 01 21:02:28.887586 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:02:28.887568    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a\": container with ID starting with 67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a not found: ID does not exist" containerID="67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a"
Jul 01 21:02:28.887636 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.887594    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a"} err="failed to get container status \"67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a\": rpc error: code = NotFound desc = could not find container \"67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a\": container with ID starting with 67642910a10fea36d3de7f1ae933064ee05947b4c3eede0c6540c3c2458faf4a not found: ID does not exist"
Jul 01 21:02:28.887636 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.887612    2569 scope.go:117] "RemoveContainer" containerID="daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230"
Jul 01 21:02:28.887846 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:02:28.887827    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230\": container with ID starting with daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230 not found: ID does not exist" containerID="daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230"
Jul 01 21:02:28.887901 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.887854    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230"} err="failed to get container status \"daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230\": rpc error: code = NotFound desc = could not find container \"daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230\": container with ID starting with daefa294a2d5c746677a57021bc3950f858bbc0b58cf3152e13db36229551230 not found: ID does not exist"
Jul 01 21:02:28.891059 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.891038    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"]
Jul 01 21:02:28.896968 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.896949    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg"]
Jul 01 21:02:28.965005 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:28.964973    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" path="/var/lib/kubelet/pods/6957fdbf-3eeb-41c5-aef0-78e1d62aab90/volumes"
Jul 01 21:02:29.018231 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:29.018201    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.48:9003\" within 1s: context deadline exceeded"
Jul 01 21:02:29.018325 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:02:29.018229    2569 logging.go:55] [core] [Channel #104 SubChannel #105]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.48:9003", ServerName: "10.134.0.48:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.48:9003: operation was canceled"
Jul 01 21:02:40.176190 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176153    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"]
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176514    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerName="main"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176525    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerName="main"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176535    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="storage-initializer"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176541    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="storage-initializer"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176548    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="main"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176554    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="main"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176565    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerName="storage-initializer"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176570    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerName="storage-initializer"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176576    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1aa9f51-9e67-4b6a-958f-d10ab26fe045" containerName="main"
Jul 01 21:02:40.176581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176581    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1aa9f51-9e67-4b6a-958f-d10ab26fe045" containerName="main"
Jul 01 21:02:40.177259 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176642    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1aa9f51-9e67-4b6a-958f-d10ab26fe045" containerName="main"
Jul 01 21:02:40.177259 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176651    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6957fdbf-3eeb-41c5-aef0-78e1d62aab90" containerName="main"
Jul 01 21:02:40.177259 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.176657    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0faf7b2-800e-40d7-b618-93c62dd257bb" containerName="main"
Jul 01 21:02:40.180769 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.180753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.184049 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.184026    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:02:40.184248 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.184204    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Jul 01 21:02:40.187467 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.187447    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"]
Jul 01 21:02:40.224591 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.224564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jzxb\" (UniqueName: \"kubernetes.io/projected/13b095dd-68de-4cdc-bdbd-4617ac4a5205-kube-api-access-4jzxb\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.224726 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.224628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.224726 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.224690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.224826 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.224739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.224826 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.224765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.224826 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.224811    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.263735 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.263707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:02:40.326017 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.325982    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326138 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326030    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326138 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326067    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326138 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326116    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326315 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326315 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jzxb\" (UniqueName: \"kubernetes.io/projected/13b095dd-68de-4cdc-bdbd-4617ac4a5205-kube-api-access-4jzxb\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326420 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326332    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326478 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326436    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.326551 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.326532    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.328392 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.328370    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.328887 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.328867    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.336177 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.336147    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jzxb\" (UniqueName: \"kubernetes.io/projected/13b095dd-68de-4cdc-bdbd-4617ac4a5205-kube-api-access-4jzxb\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.491867 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.491813    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:40.620262 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.620238    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"]
Jul 01 21:02:40.622396 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:02:40.622371    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b095dd_68de_4cdc_bdbd_4617ac4a5205.slice/crio-6013ea1ea4a4298c991d2f50b91af66014d65ce06f2c54894a0b476f5888ce9f WatchSource:0}: Error finding container 6013ea1ea4a4298c991d2f50b91af66014d65ce06f2c54894a0b476f5888ce9f: Status 404 returned error can't find the container with id 6013ea1ea4a4298c991d2f50b91af66014d65ce06f2c54894a0b476f5888ce9f
Jul 01 21:02:40.685150 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.685126    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"]
Jul 01 21:02:40.688596 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.688579    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.690773 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.690754    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-8hcn9\""
Jul 01 21:02:40.700241 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.700199    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"]
Jul 01 21:02:40.709773 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.709745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:02:40.730314 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.730287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/161586cc-f0fe-47db-999a-03e7ec1c65e4-tokenizer-uds\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.730482 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.730463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7d4k\" (UniqueName: \"kubernetes.io/projected/161586cc-f0fe-47db-999a-03e7ec1c65e4-kube-api-access-v7d4k\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.730550 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.730514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161586cc-f0fe-47db-999a-03e7ec1c65e4-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.831960 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.831883    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7d4k\" (UniqueName: \"kubernetes.io/projected/161586cc-f0fe-47db-999a-03e7ec1c65e4-kube-api-access-v7d4k\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.831960 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.831944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161586cc-f0fe-47db-999a-03e7ec1c65e4-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.832141 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.831986    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/161586cc-f0fe-47db-999a-03e7ec1c65e4-tokenizer-uds\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.832392 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.832374    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/161586cc-f0fe-47db-999a-03e7ec1c65e4-tokenizer-uds\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.834314 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.834297    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161586cc-f0fe-47db-999a-03e7ec1c65e4-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.840033 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.839988    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7d4k\" (UniqueName: \"kubernetes.io/projected/161586cc-f0fe-47db-999a-03e7ec1c65e4-kube-api-access-v7d4k\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:40.941226 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.941198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs" event={"ID":"13b095dd-68de-4cdc-bdbd-4617ac4a5205","Type":"ContainerStarted","Data":"c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722"}
Jul 01 21:02:40.941327 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.941247    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs" event={"ID":"13b095dd-68de-4cdc-bdbd-4617ac4a5205","Type":"ContainerStarted","Data":"6013ea1ea4a4298c991d2f50b91af66014d65ce06f2c54894a0b476f5888ce9f"}
Jul 01 21:02:40.960196 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.960147    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs" podStartSLOduration=0.960129583 podStartE2EDuration="960.129583ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 21:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:02:40.957644602 +0000 UTC m=+966.553530915" watchObservedRunningTime="2026-07-01 21:02:40.960129583 +0000 UTC m=+966.556015898"
Jul 01 21:02:40.999894 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:40.999869    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:41.142025 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:41.141980    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"]
Jul 01 21:02:41.144015 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:02:41.143966    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161586cc_f0fe_47db_999a_03e7ec1c65e4.slice/crio-5be827d66a8d6a429e1eae37b5c78ed569f7cc7e27e5e8956a266944f9ed1193 WatchSource:0}: Error finding container 5be827d66a8d6a429e1eae37b5c78ed569f7cc7e27e5e8956a266944f9ed1193: Status 404 returned error can't find the container with id 5be827d66a8d6a429e1eae37b5c78ed569f7cc7e27e5e8956a266944f9ed1193
Jul 01 21:02:41.492960 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:41.492929    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:41.949079 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:41.949042    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" event={"ID":"161586cc-f0fe-47db-999a-03e7ec1c65e4","Type":"ContainerStarted","Data":"df79207e959f772ab2c4fc0b709bb000652e1cf77d38ac39c1603e2b8cd5d959"}
Jul 01 21:02:41.949308 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:41.949105    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" event={"ID":"161586cc-f0fe-47db-999a-03e7ec1c65e4","Type":"ContainerStarted","Data":"5be827d66a8d6a429e1eae37b5c78ed569f7cc7e27e5e8956a266944f9ed1193"}
Jul 01 21:02:41.949407 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:41.949377    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:02:41.968111 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:41.967932    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" podStartSLOduration=1.967917134 podStartE2EDuration="1.967917134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 21:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:02:41.965427677 +0000 UTC m=+967.561313989" watchObservedRunningTime="2026-07-01 21:02:41.967917134 +0000 UTC m=+967.563803447"
Jul 01 21:02:50.492398 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:50.492361    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:50.504794 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:50.504764    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:51.003115 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:51.003086    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:02:54.310460 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:02:54.310427    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:08.794429 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:08.794342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:12.955986 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:12.955957    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:03:20.027712 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:20.027680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:20.358111 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:20.358075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:29.759866 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:29.759834    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:31.974322 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:31.974241    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"]
Jul 01 21:03:31.979496 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:31.979470    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"]
Jul 01 21:03:31.988509 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:03:31.988478    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:03:31.988509 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:03:31.988509 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:03:31.988509 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="df79207e959f772ab2c4fc0b709bb000652e1cf77d38ac39c1603e2b8cd5d959" cmd=["/bin/sleep","15"]
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:31.988524    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" message="" err=<
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:03:31.988537    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" podUID="161586cc-f0fe-47db-999a-03e7ec1c65e4" containerName="main" containerID="cri-o://df79207e959f772ab2c4fc0b709bb000652e1cf77d38ac39c1603e2b8cd5d959"
Jul 01 21:03:31.988755 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:31.988568    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" podUID="161586cc-f0fe-47db-999a-03e7ec1c65e4" containerName="main" containerID="cri-o://df79207e959f772ab2c4fc0b709bb000652e1cf77d38ac39c1603e2b8cd5d959" gracePeriod=60
Jul 01 21:03:31.997181 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:31.997094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:32.094687 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.094660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:32.205857 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.205827    2569 generic.go:356] "Generic (PLEG): container finished" podID="161586cc-f0fe-47db-999a-03e7ec1c65e4" containerID="df79207e959f772ab2c4fc0b709bb000652e1cf77d38ac39c1603e2b8cd5d959" exitCode=0
Jul 01 21:03:32.206027 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.205896    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" event={"ID":"161586cc-f0fe-47db-999a-03e7ec1c65e4","Type":"ContainerDied","Data":"df79207e959f772ab2c4fc0b709bb000652e1cf77d38ac39c1603e2b8cd5d959"}
Jul 01 21:03:32.253101 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.253078    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:03:32.448785 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.448759    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161586cc-f0fe-47db-999a-03e7ec1c65e4-tls-certs\") pod \"161586cc-f0fe-47db-999a-03e7ec1c65e4\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") "
Jul 01 21:03:32.448942 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.448797    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7d4k\" (UniqueName: \"kubernetes.io/projected/161586cc-f0fe-47db-999a-03e7ec1c65e4-kube-api-access-v7d4k\") pod \"161586cc-f0fe-47db-999a-03e7ec1c65e4\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") "
Jul 01 21:03:32.448942 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.448822    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/161586cc-f0fe-47db-999a-03e7ec1c65e4-tokenizer-uds\") pod \"161586cc-f0fe-47db-999a-03e7ec1c65e4\" (UID: \"161586cc-f0fe-47db-999a-03e7ec1c65e4\") "
Jul 01 21:03:32.449167 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.449132    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161586cc-f0fe-47db-999a-03e7ec1c65e4-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "161586cc-f0fe-47db-999a-03e7ec1c65e4" (UID: "161586cc-f0fe-47db-999a-03e7ec1c65e4"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:03:32.450903 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.450880    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161586cc-f0fe-47db-999a-03e7ec1c65e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "161586cc-f0fe-47db-999a-03e7ec1c65e4" (UID: "161586cc-f0fe-47db-999a-03e7ec1c65e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:03:32.450987 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.450921    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161586cc-f0fe-47db-999a-03e7ec1c65e4-kube-api-access-v7d4k" (OuterVolumeSpecName: "kube-api-access-v7d4k") pod "161586cc-f0fe-47db-999a-03e7ec1c65e4" (UID: "161586cc-f0fe-47db-999a-03e7ec1c65e4"). InnerVolumeSpecName "kube-api-access-v7d4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:03:32.549773 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.549707    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161586cc-f0fe-47db-999a-03e7ec1c65e4-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:32.549773 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.549732    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7d4k\" (UniqueName: \"kubernetes.io/projected/161586cc-f0fe-47db-999a-03e7ec1c65e4-kube-api-access-v7d4k\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:32.549773 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.549742    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/161586cc-f0fe-47db-999a-03e7ec1c65e4-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:32.670667 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:32.670636    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:33.212690 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:33.212660    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"
Jul 01 21:03:33.212690 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:33.212684    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs" event={"ID":"161586cc-f0fe-47db-999a-03e7ec1c65e4","Type":"ContainerDied","Data":"5be827d66a8d6a429e1eae37b5c78ed569f7cc7e27e5e8956a266944f9ed1193"}
Jul 01 21:03:33.213167 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:33.212744    2569 scope.go:117] "RemoveContainer" containerID="df79207e959f772ab2c4fc0b709bb000652e1cf77d38ac39c1603e2b8cd5d959"
Jul 01 21:03:33.231853 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:33.231828    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"]
Jul 01 21:03:33.235582 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:33.235556    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs"]
Jul 01 21:03:34.966449 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:34.966419    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161586cc-f0fe-47db-999a-03e7ec1c65e4" path="/var/lib/kubelet/pods/161586cc-f0fe-47db-999a-03e7ec1c65e4/volumes"
Jul 01 21:03:46.997918 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:46.997853    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs" podUID="13b095dd-68de-4cdc-bdbd-4617ac4a5205" containerName="main" containerID="cri-o://c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722" gracePeriod=45
Jul 01 21:03:47.002885 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.002845    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs" podUID="13b095dd-68de-4cdc-bdbd-4617ac4a5205" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/health\": EOF"
Jul 01 21:03:47.255986 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.255933    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:03:47.286921 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.286892    2569 generic.go:356] "Generic (PLEG): container finished" podID="13b095dd-68de-4cdc-bdbd-4617ac4a5205" containerID="c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722" exitCode=0
Jul 01 21:03:47.287087 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.286934    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"
Jul 01 21:03:47.287087 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.286973    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs" event={"ID":"13b095dd-68de-4cdc-bdbd-4617ac4a5205","Type":"ContainerDied","Data":"c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722"}
Jul 01 21:03:47.287087 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.287049    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs" event={"ID":"13b095dd-68de-4cdc-bdbd-4617ac4a5205","Type":"ContainerDied","Data":"6013ea1ea4a4298c991d2f50b91af66014d65ce06f2c54894a0b476f5888ce9f"}
Jul 01 21:03:47.287087 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.287082    2569 scope.go:117] "RemoveContainer" containerID="c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722"
Jul 01 21:03:47.295335 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.295324    2569 scope.go:117] "RemoveContainer" containerID="c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722"
Jul 01 21:03:47.295597 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:03:47.295575    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722\": container with ID starting with c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722 not found: ID does not exist" containerID="c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722"
Jul 01 21:03:47.295673 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.295603    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722"} err="failed to get container status \"c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722\": rpc error: code = NotFound desc = could not find container \"c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722\": container with ID starting with c99e866e7e6b3872659cbafbeb1a6c60ffffb5c203587be91133d3feebfce722 not found: ID does not exist"
Jul 01 21:03:47.375041 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375024    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-home\") pod \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") "
Jul 01 21:03:47.375141 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375056    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tls-certs\") pod \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") "
Jul 01 21:03:47.375141 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375072    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-model-cache\") pod \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") "
Jul 01 21:03:47.375141 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375094    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-dshm\") pod \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") "
Jul 01 21:03:47.375295 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tmp-dir\") pod \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") "
Jul 01 21:03:47.375295 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375205    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jzxb\" (UniqueName: \"kubernetes.io/projected/13b095dd-68de-4cdc-bdbd-4617ac4a5205-kube-api-access-4jzxb\") pod \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\" (UID: \"13b095dd-68de-4cdc-bdbd-4617ac4a5205\") "
Jul 01 21:03:47.375400 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375314    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-model-cache" (OuterVolumeSpecName: "model-cache") pod "13b095dd-68de-4cdc-bdbd-4617ac4a5205" (UID: "13b095dd-68de-4cdc-bdbd-4617ac4a5205"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:03:47.375400 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375321    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-home" (OuterVolumeSpecName: "home") pod "13b095dd-68de-4cdc-bdbd-4617ac4a5205" (UID: "13b095dd-68de-4cdc-bdbd-4617ac4a5205"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:03:47.375512 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375423    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "13b095dd-68de-4cdc-bdbd-4617ac4a5205" (UID: "13b095dd-68de-4cdc-bdbd-4617ac4a5205"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:03:47.375512 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375463    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-home\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:47.375512 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.375480    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-model-cache\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:47.377145 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.377126    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-dshm" (OuterVolumeSpecName: "dshm") pod "13b095dd-68de-4cdc-bdbd-4617ac4a5205" (UID: "13b095dd-68de-4cdc-bdbd-4617ac4a5205"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:03:47.377255 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.377147    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b095dd-68de-4cdc-bdbd-4617ac4a5205-kube-api-access-4jzxb" (OuterVolumeSpecName: "kube-api-access-4jzxb") pod "13b095dd-68de-4cdc-bdbd-4617ac4a5205" (UID: "13b095dd-68de-4cdc-bdbd-4617ac4a5205"). InnerVolumeSpecName "kube-api-access-4jzxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:03:47.377255 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.377169    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "13b095dd-68de-4cdc-bdbd-4617ac4a5205" (UID: "13b095dd-68de-4cdc-bdbd-4617ac4a5205"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:03:47.476081 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.476057    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tmp-dir\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:47.476081 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.476078    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jzxb\" (UniqueName: \"kubernetes.io/projected/13b095dd-68de-4cdc-bdbd-4617ac4a5205-kube-api-access-4jzxb\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:47.476193 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.476088    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b095dd-68de-4cdc-bdbd-4617ac4a5205-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:47.476193 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.476096    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b095dd-68de-4cdc-bdbd-4617ac4a5205-dshm\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:03:47.607651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.607626    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"]
Jul 01 21:03:47.613971 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:47.613950    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs"]
Jul 01 21:03:48.965085 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:48.965047    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13b095dd-68de-4cdc-bdbd-4617ac4a5205" path="/var/lib/kubelet/pods/13b095dd-68de-4cdc-bdbd-4617ac4a5205/volumes"
Jul 01 21:03:49.629712 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:49.629673    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:03:49.701020 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:03:49.700972    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:04:32.501463 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.501427    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:04:32.715805 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.715774    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"]
Jul 01 21:04:32.716173 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.716158    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161586cc-f0fe-47db-999a-03e7ec1c65e4" containerName="main"
Jul 01 21:04:32.716173 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.716173    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="161586cc-f0fe-47db-999a-03e7ec1c65e4" containerName="main"
Jul 01 21:04:32.716262 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.716191    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b095dd-68de-4cdc-bdbd-4617ac4a5205" containerName="main"
Jul 01 21:04:32.716262 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.716197    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b095dd-68de-4cdc-bdbd-4617ac4a5205" containerName="main"
Jul 01 21:04:32.716329 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.716268    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="161586cc-f0fe-47db-999a-03e7ec1c65e4" containerName="main"
Jul 01 21:04:32.716329 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.716279    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="13b095dd-68de-4cdc-bdbd-4617ac4a5205" containerName="main"
Jul 01 21:04:32.719220 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.719198    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.729888 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.729866    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-7pb9r\""
Jul 01 21:04:32.730015 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.729935    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:04:32.730015 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.729984    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Jul 01 21:04:32.743148 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.743127    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"]
Jul 01 21:04:32.744964 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.744937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfps\" (UniqueName: \"kubernetes.io/projected/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-kube-api-access-ldfps\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.745100 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.745081    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.745145 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.745131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.763470 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.763412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:04:32.845500 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.845471    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.845631 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.845507    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.845631 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.845554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfps\" (UniqueName: \"kubernetes.io/projected/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-kube-api-access-ldfps\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.845975 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.845950    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.847979 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.847953    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:32.853943 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:32.853925    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfps\" (UniqueName: \"kubernetes.io/projected/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-kube-api-access-ldfps\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:33.028672 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:33.028581    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:33.166583 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:33.166562    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"]
Jul 01 21:04:33.168791 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:04:33.168760    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c634c20_a1e3_4821_8eb1_14f7cbbb40f7.slice/crio-565a0dde9ee08890a9aa7739ebfe23355eb035a6213c4382099e911ebc01556a WatchSource:0}: Error finding container 565a0dde9ee08890a9aa7739ebfe23355eb035a6213c4382099e911ebc01556a: Status 404 returned error can't find the container with id 565a0dde9ee08890a9aa7739ebfe23355eb035a6213c4382099e911ebc01556a
Jul 01 21:04:33.527650 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:33.527611    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" event={"ID":"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7","Type":"ContainerStarted","Data":"7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7"}
Jul 01 21:04:33.528140 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:33.527672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" event={"ID":"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7","Type":"ContainerStarted","Data":"565a0dde9ee08890a9aa7739ebfe23355eb035a6213c4382099e911ebc01556a"}
Jul 01 21:04:33.528140 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:33.527816    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:04:33.546169 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:33.546120    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" podStartSLOduration=1.5461056 podStartE2EDuration="1.5461056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 21:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:04:33.543317126 +0000 UTC m=+1079.139203438" watchObservedRunningTime="2026-07-01 21:04:33.5461056 +0000 UTC m=+1079.141991912"
Jul 01 21:04:46.784467 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:04:46.784437    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:05:04.534458 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:05:04.534425    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:05:22.086739 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:05:22.086706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:05:22.303077 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:05:22.303041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:05:51.349057 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:05:51.349018    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:05:51.896562 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:05:51.896530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:05:58.575542 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:05:58.575453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:06:19.574304 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.574269    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"]
Jul 01 21:06:19.578600 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.578579    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.582405 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.582381    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Jul 01 21:06:19.589424 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.589400    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"]
Jul 01 21:06:19.618214 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.618185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:06:19.701066 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.701031    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50f5295-9d30-4f6d-85cc-a2487828ad56-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.701253 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.701083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.701253 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.701103    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.701253 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.701147    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.701253 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.701190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.701253 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.701240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtzl4\" (UniqueName: \"kubernetes.io/projected/e50f5295-9d30-4f6d-85cc-a2487828ad56-kube-api-access-rtzl4\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802020 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.801963    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50f5295-9d30-4f6d-85cc-a2487828ad56-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802187 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802042    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802187 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802187 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802092    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802187 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802117    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802187 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802169    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtzl4\" (UniqueName: \"kubernetes.io/projected/e50f5295-9d30-4f6d-85cc-a2487828ad56-kube-api-access-rtzl4\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802499 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802475    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802560 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802521    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.802600 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.802579    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.804353 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.804333    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.804511 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.804496    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50f5295-9d30-4f6d-85cc-a2487828ad56-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.810739 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.810717    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtzl4\" (UniqueName: \"kubernetes.io/projected/e50f5295-9d30-4f6d-85cc-a2487828ad56-kube-api-access-rtzl4\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:19.891044 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:19.891015    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:20.031131 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:20.031108    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"]
Jul 01 21:06:20.032895 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:06:20.032869    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50f5295_9d30_4f6d_85cc_a2487828ad56.slice/crio-dd7a9d208818d66497d25be17fd9930b5594088b8a000195d04ec2ee4814ef09 WatchSource:0}: Error finding container dd7a9d208818d66497d25be17fd9930b5594088b8a000195d04ec2ee4814ef09: Status 404 returned error can't find the container with id dd7a9d208818d66497d25be17fd9930b5594088b8a000195d04ec2ee4814ef09
Jul 01 21:06:20.099650 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:20.099625    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b" event={"ID":"e50f5295-9d30-4f6d-85cc-a2487828ad56","Type":"ContainerStarted","Data":"158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8"}
Jul 01 21:06:20.099771 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:20.099675    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b" event={"ID":"e50f5295-9d30-4f6d-85cc-a2487828ad56","Type":"ContainerStarted","Data":"dd7a9d208818d66497d25be17fd9930b5594088b8a000195d04ec2ee4814ef09"}
Jul 01 21:06:20.118525 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:20.118475    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b" podStartSLOduration=1.118460293 podStartE2EDuration="1.118460293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 21:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:06:20.11713061 +0000 UTC m=+1185.713016924" watchObservedRunningTime="2026-07-01 21:06:20.118460293 +0000 UTC m=+1185.714346606"
Jul 01 21:06:20.891600 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:20.891565    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:20.899788 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:20.899759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:06:29.892073 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:29.892034    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:29.904784 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:29.904749    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:30.166887 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:30.166809    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:06:30.740380 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:30.740344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:06:32.835854 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:32.835824    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:06:34.932123 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:34.932091    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:06:34.935417 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:34.935393    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:06:55.522324 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:55.522287    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"]
Jul 01 21:06:55.543120 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:55.543091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:06:57.587761 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:06:57.587711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:07:10.543565 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.543523    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b" podUID="e50f5295-9d30-4f6d-85cc-a2487828ad56" containerName="main" containerID="cri-o://158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8" gracePeriod=45
Jul 01 21:07:10.786086 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.786063    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:07:10.826439 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826387    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-tmp-dir\") pod \"e50f5295-9d30-4f6d-85cc-a2487828ad56\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") "
Jul 01 21:07:10.826439 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826421    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-model-cache\") pod \"e50f5295-9d30-4f6d-85cc-a2487828ad56\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") "
Jul 01 21:07:10.826621 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826501    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-dshm\") pod \"e50f5295-9d30-4f6d-85cc-a2487828ad56\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") "
Jul 01 21:07:10.826621 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826592    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtzl4\" (UniqueName: \"kubernetes.io/projected/e50f5295-9d30-4f6d-85cc-a2487828ad56-kube-api-access-rtzl4\") pod \"e50f5295-9d30-4f6d-85cc-a2487828ad56\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") "
Jul 01 21:07:10.826729 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826620    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50f5295-9d30-4f6d-85cc-a2487828ad56-tls-certs\") pod \"e50f5295-9d30-4f6d-85cc-a2487828ad56\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") "
Jul 01 21:07:10.826729 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826607    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e50f5295-9d30-4f6d-85cc-a2487828ad56" (UID: "e50f5295-9d30-4f6d-85cc-a2487828ad56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:07:10.826729 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826641    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-model-cache" (OuterVolumeSpecName: "model-cache") pod "e50f5295-9d30-4f6d-85cc-a2487828ad56" (UID: "e50f5295-9d30-4f6d-85cc-a2487828ad56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:07:10.826729 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826698    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-home\") pod \"e50f5295-9d30-4f6d-85cc-a2487828ad56\" (UID: \"e50f5295-9d30-4f6d-85cc-a2487828ad56\") "
Jul 01 21:07:10.826980 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.826959    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-home" (OuterVolumeSpecName: "home") pod "e50f5295-9d30-4f6d-85cc-a2487828ad56" (UID: "e50f5295-9d30-4f6d-85cc-a2487828ad56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:07:10.827062 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.827037    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-model-cache\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:10.827062 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.827057    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-tmp-dir\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:10.828484 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.828460    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-dshm" (OuterVolumeSpecName: "dshm") pod "e50f5295-9d30-4f6d-85cc-a2487828ad56" (UID: "e50f5295-9d30-4f6d-85cc-a2487828ad56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:07:10.828599 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.828556    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e50f5295-9d30-4f6d-85cc-a2487828ad56-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e50f5295-9d30-4f6d-85cc-a2487828ad56" (UID: "e50f5295-9d30-4f6d-85cc-a2487828ad56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:07:10.828964 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.828946    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50f5295-9d30-4f6d-85cc-a2487828ad56-kube-api-access-rtzl4" (OuterVolumeSpecName: "kube-api-access-rtzl4") pod "e50f5295-9d30-4f6d-85cc-a2487828ad56" (UID: "e50f5295-9d30-4f6d-85cc-a2487828ad56"). InnerVolumeSpecName "kube-api-access-rtzl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:07:10.927568 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.927540    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-dshm\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:10.927568 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.927564    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtzl4\" (UniqueName: \"kubernetes.io/projected/e50f5295-9d30-4f6d-85cc-a2487828ad56-kube-api-access-rtzl4\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:10.927698 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.927577    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50f5295-9d30-4f6d-85cc-a2487828ad56-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:10.927698 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:10.927585    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50f5295-9d30-4f6d-85cc-a2487828ad56-home\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:11.376661 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.376634    2569 generic.go:356] "Generic (PLEG): container finished" podID="e50f5295-9d30-4f6d-85cc-a2487828ad56" containerID="158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8" exitCode=0
Jul 01 21:07:11.376799 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.376682    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"
Jul 01 21:07:11.376799 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.376713    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b" event={"ID":"e50f5295-9d30-4f6d-85cc-a2487828ad56","Type":"ContainerDied","Data":"158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8"}
Jul 01 21:07:11.376799 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.376789    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b" event={"ID":"e50f5295-9d30-4f6d-85cc-a2487828ad56","Type":"ContainerDied","Data":"dd7a9d208818d66497d25be17fd9930b5594088b8a000195d04ec2ee4814ef09"}
Jul 01 21:07:11.376906 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.376813    2569 scope.go:117] "RemoveContainer" containerID="158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8"
Jul 01 21:07:11.387285 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.387270    2569 scope.go:117] "RemoveContainer" containerID="158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8"
Jul 01 21:07:11.387561 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:07:11.387542    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8\": container with ID starting with 158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8 not found: ID does not exist" containerID="158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8"
Jul 01 21:07:11.387612 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.387580    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8"} err="failed to get container status \"158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8\": rpc error: code = NotFound desc = could not find container \"158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8\": container with ID starting with 158a125b08f955faff69bf9bf59b50f818b3aec8dd20bbc6f8ee163a3e7661a8 not found: ID does not exist"
Jul 01 21:07:11.396278 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.396257    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"]
Jul 01 21:07:11.399962 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:11.399939    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b"]
Jul 01 21:07:12.965401 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:12.965368    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50f5295-9d30-4f6d-85cc-a2487828ad56" path="/var/lib/kubelet/pods/e50f5295-9d30-4f6d-85cc-a2487828ad56/volumes"
Jul 01 21:07:15.857171 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:15.857140    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"]
Jul 01 21:07:15.863137 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:15.863096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:07:15.867409 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:07:15.867380    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:07:15.867409 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:07:15.867409 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:07:15.867409 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7" cmd=["/bin/sleep","15"]
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:15.867430    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" message="" err=<
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:07:15.867446    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" podUID="5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" containerName="main" containerID="cri-o://7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7"
Jul 01 21:07:15.867691 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:15.867502    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" podUID="5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" containerName="main" containerID="cri-o://7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7" gracePeriod=60
Jul 01 21:07:15.929270 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:15.929246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:07:16.129020 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.128984    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:07:16.270842 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.270816    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldfps\" (UniqueName: \"kubernetes.io/projected/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-kube-api-access-ldfps\") pod \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") "
Jul 01 21:07:16.271036 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.270862    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tls-certs\") pod \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") "
Jul 01 21:07:16.271036 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.270931    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tokenizer-uds\") pod \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\" (UID: \"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7\") "
Jul 01 21:07:16.271258 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.271234    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" (UID: "5c634c20-a1e3-4821-8eb1-14f7cbbb40f7"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:07:16.272983 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.272957    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" (UID: "5c634c20-a1e3-4821-8eb1-14f7cbbb40f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:07:16.272983 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.272956    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-kube-api-access-ldfps" (OuterVolumeSpecName: "kube-api-access-ldfps") pod "5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" (UID: "5c634c20-a1e3-4821-8eb1-14f7cbbb40f7"). InnerVolumeSpecName "kube-api-access-ldfps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:07:16.372561 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.372497    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:16.372561 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.372518    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldfps\" (UniqueName: \"kubernetes.io/projected/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-kube-api-access-ldfps\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:16.372561 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.372528    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:07:16.403287 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.403262    2569 generic.go:356] "Generic (PLEG): container finished" podID="5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" containerID="7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7" exitCode=0
Jul 01 21:07:16.403417 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.403329    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"
Jul 01 21:07:16.403417 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.403349    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" event={"ID":"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7","Type":"ContainerDied","Data":"7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7"}
Jul 01 21:07:16.403417 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.403404    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2" event={"ID":"5c634c20-a1e3-4821-8eb1-14f7cbbb40f7","Type":"ContainerDied","Data":"565a0dde9ee08890a9aa7739ebfe23355eb035a6213c4382099e911ebc01556a"}
Jul 01 21:07:16.403565 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.403423    2569 scope.go:117] "RemoveContainer" containerID="7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7"
Jul 01 21:07:16.413864 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.413847    2569 scope.go:117] "RemoveContainer" containerID="7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7"
Jul 01 21:07:16.414126 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:07:16.414107    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7\": container with ID starting with 7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7 not found: ID does not exist" containerID="7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7"
Jul 01 21:07:16.414208 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.414135    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7"} err="failed to get container status \"7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7\": rpc error: code = NotFound desc = could not find container \"7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7\": container with ID starting with 7aa639ff1684c63465f276f2d581194045958c7db1a44f3331dee37098ec26f7 not found: ID does not exist"
Jul 01 21:07:16.426450 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.426422    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"]
Jul 01 21:07:16.431594 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.431576    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2"]
Jul 01 21:07:16.964887 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:16.964852    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" path="/var/lib/kubelet/pods/5c634c20-a1e3-4821-8eb1-14f7cbbb40f7/volumes"
Jul 01 21:07:53.126519 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.126487    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:07:53.332981 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.332942    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"]
Jul 01 21:07:53.333402 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.333386    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50f5295-9d30-4f6d-85cc-a2487828ad56" containerName="main"
Jul 01 21:07:53.333402 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.333404    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50f5295-9d30-4f6d-85cc-a2487828ad56" containerName="main"
Jul 01 21:07:53.333502 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.333417    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" containerName="main"
Jul 01 21:07:53.333502 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.333422    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" containerName="main"
Jul 01 21:07:53.333502 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.333486    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c634c20-a1e3-4821-8eb1-14f7cbbb40f7" containerName="main"
Jul 01 21:07:53.333502 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.333496    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50f5295-9d30-4f6d-85cc-a2487828ad56" containerName="main"
Jul 01 21:07:53.337934 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.337916    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.340524 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.340501    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 21:07:53.341317 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.341299    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:07:53.341376 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.341317    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-lbgsj\""
Jul 01 21:07:53.341434 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.341325    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\""
Jul 01 21:07:53.345848 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.345828    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"]
Jul 01 21:07:53.359213 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.359192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:07:53.372491 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.372470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtcd\" (UniqueName: \"kubernetes.io/projected/3f9a5231-a165-4873-b546-a40405b4aaa2-kube-api-access-qjtcd\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.372597 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.372501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9a5231-a165-4873-b546-a40405b4aaa2-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.372597 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.372536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.372597 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.372557    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.473360 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.473273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9a5231-a165-4873-b546-a40405b4aaa2-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.473491 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.473438    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.473491 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.473477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.473615 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.473551    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtcd\" (UniqueName: \"kubernetes.io/projected/3f9a5231-a165-4873-b546-a40405b4aaa2-kube-api-access-qjtcd\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.473855 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.473829    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.473928 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.473857    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.475629 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.475611    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9a5231-a165-4873-b546-a40405b4aaa2-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.481356 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.481330    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtcd\" (UniqueName: \"kubernetes.io/projected/3f9a5231-a165-4873-b546-a40405b4aaa2-kube-api-access-qjtcd\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.649075 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.649041    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:53.785839 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:53.785814    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"]
Jul 01 21:07:53.787952 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:07:53.787927    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9a5231_a165_4873_b546_a40405b4aaa2.slice/crio-403daa62cf8077ffee13fd4198b8ba09ec6dfccaf95cfdfcc76e4f6648b8961f WatchSource:0}: Error finding container 403daa62cf8077ffee13fd4198b8ba09ec6dfccaf95cfdfcc76e4f6648b8961f: Status 404 returned error can't find the container with id 403daa62cf8077ffee13fd4198b8ba09ec6dfccaf95cfdfcc76e4f6648b8961f
Jul 01 21:07:54.604680 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:54.604652    2569 generic.go:356] "Generic (PLEG): container finished" podID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerID="43c8dc1943908a60091f9f6307e2b63ddcc0197fae3807e80fd80af9b75d967f" exitCode=0
Jul 01 21:07:54.605055 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:54.604740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" event={"ID":"3f9a5231-a165-4873-b546-a40405b4aaa2","Type":"ContainerDied","Data":"43c8dc1943908a60091f9f6307e2b63ddcc0197fae3807e80fd80af9b75d967f"}
Jul 01 21:07:54.605055 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:54.604785    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" event={"ID":"3f9a5231-a165-4873-b546-a40405b4aaa2","Type":"ContainerStarted","Data":"403daa62cf8077ffee13fd4198b8ba09ec6dfccaf95cfdfcc76e4f6648b8961f"}
Jul 01 21:07:55.611499 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:55.611460    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" event={"ID":"3f9a5231-a165-4873-b546-a40405b4aaa2","Type":"ContainerStarted","Data":"28f780f5c392900ed4949113a80eaf5e93c7ad048cea7b93cc8b6ed3c5cc7447"}
Jul 01 21:07:55.611961 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:55.611581    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:07:55.632370 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:07:55.632323    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" podStartSLOduration=1.9430039209999999 podStartE2EDuration="2.63230922s" totalImagesPullingTime="0s" totalInitContainerRuntime="689.305299ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:07:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:07:55.630619977 +0000 UTC m=+1281.226506306" watchObservedRunningTime="2026-07-01 21:07:55.63230922 +0000 UTC m=+1281.228195533"
Jul 01 21:08:00.099825 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:08:00.099791    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:08:01.900989 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:08:01.900954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:08:01.995914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:08:01.995879    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:08:26.619312 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:08:26.619283    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:08:26.702026 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:08:26.701975    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:08:39.238750 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:08:39.238715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:09:07.575019 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.574925    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:09:07.753824 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.753797    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"]
Jul 01 21:09:07.757029 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.757011    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.760583 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.760552    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa-dockercfg-sfjxs\""
Jul 01 21:09:07.761301 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.761280    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs\""
Jul 01 21:09:07.773038 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.773017    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"]
Jul 01 21:09:07.803990 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.803969    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:09:07.819276 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.819252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tokenizer-uds\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.819382 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.819295    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kserve-provision-location\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.819382 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.819322    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h46b\" (UniqueName: \"kubernetes.io/projected/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kube-api-access-5h46b\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.819459 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.819380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.920377 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.920349    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kserve-provision-location\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.920522 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.920392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h46b\" (UniqueName: \"kubernetes.io/projected/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kube-api-access-5h46b\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.920522 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.920425    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.920522 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.920516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tokenizer-uds\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.920813 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.920790    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kserve-provision-location\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.920866 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.920818    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tokenizer-uds\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.922834 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.922811    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:07.929430 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:07.929404    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h46b\" (UniqueName: \"kubernetes.io/projected/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kube-api-access-5h46b\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") " pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:08.066749 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:08.066726    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:08.207184 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:08.207154    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"]
Jul 01 21:09:08.207646 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:09:08.207626    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a750e2_ad06_48ef_a810_b7d53d5358cb.slice/crio-154bae59dad33a5e379a8f3b5e08898d10ea838c61753c65ae7872555e3bf7a0 WatchSource:0}: Error finding container 154bae59dad33a5e379a8f3b5e08898d10ea838c61753c65ae7872555e3bf7a0: Status 404 returned error can't find the container with id 154bae59dad33a5e379a8f3b5e08898d10ea838c61753c65ae7872555e3bf7a0
Jul 01 21:09:09.004592 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:09.004561    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerID="f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109" exitCode=0
Jul 01 21:09:09.004900 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:09.004634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" event={"ID":"e1a750e2-ad06-48ef-a810-b7d53d5358cb","Type":"ContainerDied","Data":"f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109"}
Jul 01 21:09:09.004900 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:09.004680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" event={"ID":"e1a750e2-ad06-48ef-a810-b7d53d5358cb","Type":"ContainerStarted","Data":"154bae59dad33a5e379a8f3b5e08898d10ea838c61753c65ae7872555e3bf7a0"}
Jul 01 21:09:10.013946 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:10.013915    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" event={"ID":"e1a750e2-ad06-48ef-a810-b7d53d5358cb","Type":"ContainerStarted","Data":"9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4"}
Jul 01 21:09:10.014382 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:10.014014    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:10.039324 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:10.039278    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" podStartSLOduration=2.365506603 podStartE2EDuration="3.039264156s" totalImagesPullingTime="0s" totalInitContainerRuntime="673.757553ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:09:10.03758364 +0000 UTC m=+1355.633469952" watchObservedRunningTime="2026-07-01 21:09:10.039264156 +0000 UTC m=+1355.635150493"
Jul 01 21:09:18.679574 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:18.679539    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:09:41.020489 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:41.020461    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:09:44.930965 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:44.930927    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"]
Jul 01 21:09:44.933890 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:44.933863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:09:44.940850 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:09:44.940813    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:09:44.940850 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:09:44.940850 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:09:44.940850 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="28f780f5c392900ed4949113a80eaf5e93c7ad048cea7b93cc8b6ed3c5cc7447" cmd=["/bin/sleep","15"]
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:44.940866    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" message="" err=<
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:09:44.940879    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerName="main" containerID="cri-o://28f780f5c392900ed4949113a80eaf5e93c7ad048cea7b93cc8b6ed3c5cc7447"
Jul 01 21:09:44.941140 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:44.940925    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerName="main" containerID="cri-o://28f780f5c392900ed4949113a80eaf5e93c7ad048cea7b93cc8b6ed3c5cc7447" gracePeriod=60
Jul 01 21:09:44.998696 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:44.998673    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:09:45.199322 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.199285    2569 generic.go:356] "Generic (PLEG): container finished" podID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerID="28f780f5c392900ed4949113a80eaf5e93c7ad048cea7b93cc8b6ed3c5cc7447" exitCode=0
Jul 01 21:09:45.199455 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.199318    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" event={"ID":"3f9a5231-a165-4873-b546-a40405b4aaa2","Type":"ContainerDied","Data":"28f780f5c392900ed4949113a80eaf5e93c7ad048cea7b93cc8b6ed3c5cc7447"}
Jul 01 21:09:45.199455 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.199373    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf" event={"ID":"3f9a5231-a165-4873-b546-a40405b4aaa2","Type":"ContainerDied","Data":"403daa62cf8077ffee13fd4198b8ba09ec6dfccaf95cfdfcc76e4f6648b8961f"}
Jul 01 21:09:45.199455 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.199395    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="403daa62cf8077ffee13fd4198b8ba09ec6dfccaf95cfdfcc76e4f6648b8961f"
Jul 01 21:09:45.202177 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.202158    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:09:45.244377 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.244351    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9a5231-a165-4873-b546-a40405b4aaa2-tls-certs\") pod \"3f9a5231-a165-4873-b546-a40405b4aaa2\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") "
Jul 01 21:09:45.244496 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.244397    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-kserve-provision-location\") pod \"3f9a5231-a165-4873-b546-a40405b4aaa2\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") "
Jul 01 21:09:45.244496 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.244436    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-tokenizer-uds\") pod \"3f9a5231-a165-4873-b546-a40405b4aaa2\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") "
Jul 01 21:09:45.244579 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.244497    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjtcd\" (UniqueName: \"kubernetes.io/projected/3f9a5231-a165-4873-b546-a40405b4aaa2-kube-api-access-qjtcd\") pod \"3f9a5231-a165-4873-b546-a40405b4aaa2\" (UID: \"3f9a5231-a165-4873-b546-a40405b4aaa2\") "
Jul 01 21:09:45.244752 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.244727    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "3f9a5231-a165-4873-b546-a40405b4aaa2" (UID: "3f9a5231-a165-4873-b546-a40405b4aaa2"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:09:45.245139 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.245122    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3f9a5231-a165-4873-b546-a40405b4aaa2" (UID: "3f9a5231-a165-4873-b546-a40405b4aaa2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:09:45.246415 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.246385    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9a5231-a165-4873-b546-a40405b4aaa2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f9a5231-a165-4873-b546-a40405b4aaa2" (UID: "3f9a5231-a165-4873-b546-a40405b4aaa2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:09:45.246506 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.246446    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9a5231-a165-4873-b546-a40405b4aaa2-kube-api-access-qjtcd" (OuterVolumeSpecName: "kube-api-access-qjtcd") pod "3f9a5231-a165-4873-b546-a40405b4aaa2" (UID: "3f9a5231-a165-4873-b546-a40405b4aaa2"). InnerVolumeSpecName "kube-api-access-qjtcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:09:45.345578 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.345543    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9a5231-a165-4873-b546-a40405b4aaa2-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:09:45.345578 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.345573    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:09:45.345578 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.345584    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3f9a5231-a165-4873-b546-a40405b4aaa2-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:09:45.345823 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:45.345593    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjtcd\" (UniqueName: \"kubernetes.io/projected/3f9a5231-a165-4873-b546-a40405b4aaa2-kube-api-access-qjtcd\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:09:46.204936 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:46.204907    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"
Jul 01 21:09:46.227618 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:46.227589    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"]
Jul 01 21:09:46.233552 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:46.233531    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf"]
Jul 01 21:09:46.965116 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:09:46.965084    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" path="/var/lib/kubelet/pods/3f9a5231-a165-4873-b546-a40405b4aaa2/volumes"
Jul 01 21:10:12.198515 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.198484    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:10:12.421728 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.421689    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"]
Jul 01 21:10:12.422343 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.422319    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerName="storage-initializer"
Jul 01 21:10:12.422343 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.422342    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerName="storage-initializer"
Jul 01 21:10:12.422538 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.422356    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerName="main"
Jul 01 21:10:12.422538 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.422364    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerName="main"
Jul 01 21:10:12.422538 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.422496    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f9a5231-a165-4873-b546-a40405b4aaa2" containerName="main"
Jul 01 21:10:12.426347 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.426327    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.429101 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.429073    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa-dockercfg-rp64m\""
Jul 01 21:10:12.429206 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.429117    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs\""
Jul 01 21:10:12.436657 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.436636    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"]
Jul 01 21:10:12.457729 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.457671    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:10:12.558048 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.558025    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e937707f-1529-4890-aa0a-04f5e11305eb-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.558150 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.558055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.558150 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.558119    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrj2l\" (UniqueName: \"kubernetes.io/projected/e937707f-1529-4890-aa0a-04f5e11305eb-kube-api-access-vrj2l\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.558265 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.558247    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.659211 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.659182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.659404 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.659316    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e937707f-1529-4890-aa0a-04f5e11305eb-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.659404 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.659352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.659404 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.659394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrj2l\" (UniqueName: \"kubernetes.io/projected/e937707f-1529-4890-aa0a-04f5e11305eb-kube-api-access-vrj2l\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.659667 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.659640    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.659752 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.659729    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.661774 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.661752    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e937707f-1529-4890-aa0a-04f5e11305eb-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.667856 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.667834    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrj2l\" (UniqueName: \"kubernetes.io/projected/e937707f-1529-4890-aa0a-04f5e11305eb-kube-api-access-vrj2l\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.738628 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.738560    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:12.872330 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:12.872306    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"]
Jul 01 21:10:12.874667 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:10:12.874630    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode937707f_1529_4890_aa0a_04f5e11305eb.slice/crio-2ca8cfae5c3fe14b752189c0960b73d8788d7281488ed6f04145ab9235ac71d5 WatchSource:0}: Error finding container 2ca8cfae5c3fe14b752189c0960b73d8788d7281488ed6f04145ab9235ac71d5: Status 404 returned error can't find the container with id 2ca8cfae5c3fe14b752189c0960b73d8788d7281488ed6f04145ab9235ac71d5
Jul 01 21:10:13.355200 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:13.355155    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" event={"ID":"e937707f-1529-4890-aa0a-04f5e11305eb","Type":"ContainerStarted","Data":"cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc"}
Jul 01 21:10:13.355635 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:13.355214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" event={"ID":"e937707f-1529-4890-aa0a-04f5e11305eb","Type":"ContainerStarted","Data":"2ca8cfae5c3fe14b752189c0960b73d8788d7281488ed6f04145ab9235ac71d5"}
Jul 01 21:10:14.362322 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:14.362287    2569 generic.go:356] "Generic (PLEG): container finished" podID="e937707f-1529-4890-aa0a-04f5e11305eb" containerID="cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc" exitCode=0
Jul 01 21:10:14.362322 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:14.362326    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" event={"ID":"e937707f-1529-4890-aa0a-04f5e11305eb","Type":"ContainerDied","Data":"cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc"}
Jul 01 21:10:15.369056 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:15.369021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" event={"ID":"e937707f-1529-4890-aa0a-04f5e11305eb","Type":"ContainerStarted","Data":"f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f"}
Jul 01 21:10:15.369440 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:15.369141    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:10:15.387170 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:15.387126    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" podStartSLOduration=2.732149202 podStartE2EDuration="3.387114487s" totalImagesPullingTime="0s" totalInitContainerRuntime="654.965285ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:10:15.385679501 +0000 UTC m=+1420.981565826" watchObservedRunningTime="2026-07-01 21:10:15.387114487 +0000 UTC m=+1420.983000799"
Jul 01 21:10:17.581532 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:17.581500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:10:39.111091 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:39.111063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:10:46.377174 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:10:46.377145    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:11:12.879621 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:12.879590    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"]
Jul 01 21:11:12.888964 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:11:12.888926    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:11:12.888964 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:11:12.888964 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:11:12.888964 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4" cmd=["/bin/sleep","15"]
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:12.888973    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" message="" err=<
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:11:12.888986    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerName="main" containerID="cri-o://9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4"
Jul 01 21:11:12.889250 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:12.889048    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerName="main" containerID="cri-o://9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4" gracePeriod=60
Jul 01 21:11:13.143963 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.143906    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:11:13.260075 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.260040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:11:13.264051 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.264024    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h46b\" (UniqueName: \"kubernetes.io/projected/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kube-api-access-5h46b\") pod \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") "
Jul 01 21:11:13.264184 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.264068    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tokenizer-uds\") pod \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") "
Jul 01 21:11:13.264184 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.264112    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kserve-provision-location\") pod \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") "
Jul 01 21:11:13.264184 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.264136    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tls-certs\") pod \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\" (UID: \"e1a750e2-ad06-48ef-a810-b7d53d5358cb\") "
Jul 01 21:11:13.264388 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.264362    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "e1a750e2-ad06-48ef-a810-b7d53d5358cb" (UID: "e1a750e2-ad06-48ef-a810-b7d53d5358cb"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:11:13.264488 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.264470    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:11:13.264799 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.264776    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e1a750e2-ad06-48ef-a810-b7d53d5358cb" (UID: "e1a750e2-ad06-48ef-a810-b7d53d5358cb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:11:13.266176 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.266150    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e1a750e2-ad06-48ef-a810-b7d53d5358cb" (UID: "e1a750e2-ad06-48ef-a810-b7d53d5358cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:11:13.266294 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.266203    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kube-api-access-5h46b" (OuterVolumeSpecName: "kube-api-access-5h46b") pod "e1a750e2-ad06-48ef-a810-b7d53d5358cb" (UID: "e1a750e2-ad06-48ef-a810-b7d53d5358cb"). InnerVolumeSpecName "kube-api-access-5h46b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:11:13.361700 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.361670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:11:13.364893 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.364868    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h46b\" (UniqueName: \"kubernetes.io/projected/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kube-api-access-5h46b\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:11:13.364893 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.364894    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1a750e2-ad06-48ef-a810-b7d53d5358cb-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:11:13.365066 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.364906    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a750e2-ad06-48ef-a810-b7d53d5358cb-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:11:13.698603 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.698571    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerID="9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4" exitCode=0
Jul 01 21:11:13.698776 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.698648    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"
Jul 01 21:11:13.698776 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.698650    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" event={"ID":"e1a750e2-ad06-48ef-a810-b7d53d5358cb","Type":"ContainerDied","Data":"9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4"}
Jul 01 21:11:13.698776 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.698722    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs" event={"ID":"e1a750e2-ad06-48ef-a810-b7d53d5358cb","Type":"ContainerDied","Data":"154bae59dad33a5e379a8f3b5e08898d10ea838c61753c65ae7872555e3bf7a0"}
Jul 01 21:11:13.698776 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.698742    2569 scope.go:117] "RemoveContainer" containerID="9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4"
Jul 01 21:11:13.708209 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.708081    2569 scope.go:117] "RemoveContainer" containerID="f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109"
Jul 01 21:11:13.716350 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.716334    2569 scope.go:117] "RemoveContainer" containerID="9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4"
Jul 01 21:11:13.716595 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:11:13.716577    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4\": container with ID starting with 9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4 not found: ID does not exist" containerID="9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4"
Jul 01 21:11:13.716639 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.716605    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4"} err="failed to get container status \"9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4\": rpc error: code = NotFound desc = could not find container \"9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4\": container with ID starting with 9758cbdb658e31b744f854d2f2bc48cbd2c80bb78407c3efed053bd741957df4 not found: ID does not exist"
Jul 01 21:11:13.716639 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.716625    2569 scope.go:117] "RemoveContainer" containerID="f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109"
Jul 01 21:11:13.716854 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:11:13.716837    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109\": container with ID starting with f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109 not found: ID does not exist" containerID="f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109"
Jul 01 21:11:13.716891 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.716862    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109"} err="failed to get container status \"f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109\": rpc error: code = NotFound desc = could not find container \"f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109\": container with ID starting with f1c9ea3e977fc49228a7282d2c1758fff1bb39bc6d006f4086b90938820d4109 not found: ID does not exist"
Jul 01 21:11:13.721461 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.721439    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"]
Jul 01 21:11:13.727879 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:13.727860    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs"]
Jul 01 21:11:14.965266 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:14.965240    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" path="/var/lib/kubelet/pods/e1a750e2-ad06-48ef-a810-b7d53d5358cb/volumes"
Jul 01 21:11:34.968438 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:34.968409    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:11:34.976334 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:34.976310    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:11:41.365720 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.365683    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:11:41.618220 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.618127    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"]
Jul 01 21:11:41.618532 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.618519    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerName="main"
Jul 01 21:11:41.618579 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.618534    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerName="main"
Jul 01 21:11:41.618579 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.618562    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerName="storage-initializer"
Jul 01 21:11:41.618579 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.618571    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerName="storage-initializer"
Jul 01 21:11:41.618725 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.618674    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1a750e2-ad06-48ef-a810-b7d53d5358cb" containerName="main"
Jul 01 21:11:41.623344 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.623323    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.626499 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.626478    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-test-kserve-self-signed-certs\""
Jul 01 21:11:41.626499 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.626496    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-test-epp-sa-dockercfg-ckllv\""
Jul 01 21:11:41.633939 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.633915    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"]
Jul 01 21:11:41.650291 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.650265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:11:41.708665 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.708638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h6ql\" (UniqueName: \"kubernetes.io/projected/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kube-api-access-2h6ql\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.708794 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.708686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kserve-provision-location\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.708794 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.708708    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.708794 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.708761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tokenizer-uds\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.809466 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.809441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tokenizer-uds\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.809576 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.809501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6ql\" (UniqueName: \"kubernetes.io/projected/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kube-api-access-2h6ql\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.809576 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.809533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kserve-provision-location\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.809576 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.809552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.809940 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.809919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tokenizer-uds\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.810043 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.809955    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kserve-provision-location\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.812154 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.812134    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.817777 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.817755    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h6ql\" (UniqueName: \"kubernetes.io/projected/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kube-api-access-2h6ql\") pod \"custom-route-timeout-test-kserve-router-scheduler-5599744dttprw\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:41.933906 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:41.933800    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:42.094796 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:42.094769    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"]
Jul 01 21:11:42.095867 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:11:42.095838    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b06a717_1696_48d1_85ff_2ed9d75b4d1c.slice/crio-d59104881e9d82c83d368f430c838deb4af49edb94a3241e35deb768a34efbb2 WatchSource:0}: Error finding container d59104881e9d82c83d368f430c838deb4af49edb94a3241e35deb768a34efbb2: Status 404 returned error can't find the container with id d59104881e9d82c83d368f430c838deb4af49edb94a3241e35deb768a34efbb2
Jul 01 21:11:42.866470 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:42.866435    2569 generic.go:356] "Generic (PLEG): container finished" podID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerID="f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39" exitCode=0
Jul 01 21:11:42.866885 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:42.866483    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" event={"ID":"6b06a717-1696-48d1-85ff-2ed9d75b4d1c","Type":"ContainerDied","Data":"f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39"}
Jul 01 21:11:42.866885 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:42.866534    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" event={"ID":"6b06a717-1696-48d1-85ff-2ed9d75b4d1c","Type":"ContainerStarted","Data":"d59104881e9d82c83d368f430c838deb4af49edb94a3241e35deb768a34efbb2"}
Jul 01 21:11:43.873661 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:43.873624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" event={"ID":"6b06a717-1696-48d1-85ff-2ed9d75b4d1c","Type":"ContainerStarted","Data":"93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5"}
Jul 01 21:11:43.874098 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:43.873827    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:11:43.898233 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:43.898191    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" podStartSLOduration=2.232973386 podStartE2EDuration="2.898179184s" totalImagesPullingTime="0s" totalInitContainerRuntime="665.205798ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:11:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:11:43.896159772 +0000 UTC m=+1509.492046100" watchObservedRunningTime="2026-07-01 21:11:43.898179184 +0000 UTC m=+1509.494065497"
Jul 01 21:11:55.642737 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:11:55.642704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:12:14.884015 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:12:14.883974    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:12:47.794250 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:12:47.794209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:13:37.636469 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.636432    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"]
Jul 01 21:13:37.642166 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.642135    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:13:37.646557 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:37.646526    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:13:37.646557 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:13:37.646557 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:13:37.646557 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f" cmd=["/bin/sleep","15"]
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.646579    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" message="" err=<
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:37.646595    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" containerName="main" containerID="cri-o://f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f"
Jul 01 21:13:37.646840 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.646650    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" containerName="main" containerID="cri-o://f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f" gracePeriod=60
Jul 01 21:13:37.729478 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.729455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:13:37.897914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.897857    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:13:37.995762 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.995732    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-kserve-provision-location\") pod \"e937707f-1529-4890-aa0a-04f5e11305eb\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") "
Jul 01 21:13:37.995922 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.995788    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-tokenizer-uds\") pod \"e937707f-1529-4890-aa0a-04f5e11305eb\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") "
Jul 01 21:13:37.995922 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.995835    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrj2l\" (UniqueName: \"kubernetes.io/projected/e937707f-1529-4890-aa0a-04f5e11305eb-kube-api-access-vrj2l\") pod \"e937707f-1529-4890-aa0a-04f5e11305eb\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") "
Jul 01 21:13:37.995922 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.995859    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e937707f-1529-4890-aa0a-04f5e11305eb-tls-certs\") pod \"e937707f-1529-4890-aa0a-04f5e11305eb\" (UID: \"e937707f-1529-4890-aa0a-04f5e11305eb\") "
Jul 01 21:13:37.996101 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.996037    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "e937707f-1529-4890-aa0a-04f5e11305eb" (UID: "e937707f-1529-4890-aa0a-04f5e11305eb"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:13:37.996452 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.996430    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e937707f-1529-4890-aa0a-04f5e11305eb" (UID: "e937707f-1529-4890-aa0a-04f5e11305eb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:13:37.997921 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.997900    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e937707f-1529-4890-aa0a-04f5e11305eb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e937707f-1529-4890-aa0a-04f5e11305eb" (UID: "e937707f-1529-4890-aa0a-04f5e11305eb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:13:37.997986 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:37.997955    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e937707f-1529-4890-aa0a-04f5e11305eb-kube-api-access-vrj2l" (OuterVolumeSpecName: "kube-api-access-vrj2l") pod "e937707f-1529-4890-aa0a-04f5e11305eb" (UID: "e937707f-1529-4890-aa0a-04f5e11305eb"). InnerVolumeSpecName "kube-api-access-vrj2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:13:38.097412 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.097390    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:38.097412 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.097410    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e937707f-1529-4890-aa0a-04f5e11305eb-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:38.097539 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.097420    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrj2l\" (UniqueName: \"kubernetes.io/projected/e937707f-1529-4890-aa0a-04f5e11305eb-kube-api-access-vrj2l\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:38.097539 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.097429    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e937707f-1529-4890-aa0a-04f5e11305eb-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:38.514166 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.514135    2569 generic.go:356] "Generic (PLEG): container finished" podID="e937707f-1529-4890-aa0a-04f5e11305eb" containerID="f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f" exitCode=0
Jul 01 21:13:38.514339 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.514178    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"
Jul 01 21:13:38.514339 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.514219    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" event={"ID":"e937707f-1529-4890-aa0a-04f5e11305eb","Type":"ContainerDied","Data":"f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f"}
Jul 01 21:13:38.514339 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.514274    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm" event={"ID":"e937707f-1529-4890-aa0a-04f5e11305eb","Type":"ContainerDied","Data":"2ca8cfae5c3fe14b752189c0960b73d8788d7281488ed6f04145ab9235ac71d5"}
Jul 01 21:13:38.514339 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.514296    2569 scope.go:117] "RemoveContainer" containerID="f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f"
Jul 01 21:13:38.524046 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.524028    2569 scope.go:117] "RemoveContainer" containerID="cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc"
Jul 01 21:13:38.531686 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.531669    2569 scope.go:117] "RemoveContainer" containerID="f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f"
Jul 01 21:13:38.531916 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:38.531895    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f\": container with ID starting with f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f not found: ID does not exist" containerID="f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f"
Jul 01 21:13:38.531975 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.531922    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f"} err="failed to get container status \"f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f\": rpc error: code = NotFound desc = could not find container \"f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f\": container with ID starting with f4d567214d23f3fc3307a2bd253f2decfde1c141e378eedf2c9e54716e7dd20f not found: ID does not exist"
Jul 01 21:13:38.531975 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.531938    2569 scope.go:117] "RemoveContainer" containerID="cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc"
Jul 01 21:13:38.532240 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:38.532222    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc\": container with ID starting with cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc not found: ID does not exist" containerID="cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc"
Jul 01 21:13:38.532285 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.532246    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc"} err="failed to get container status \"cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc\": rpc error: code = NotFound desc = could not find container \"cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc\": container with ID starting with cd3957b12cc47f986956c042fa7b5065f629a7472226e573ea6e0eba6273eccc not found: ID does not exist"
Jul 01 21:13:38.536523 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.536503    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"]
Jul 01 21:13:38.540447 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.540429    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm"]
Jul 01 21:13:38.965511 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:38.965485    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" path="/var/lib/kubelet/pods/e937707f-1529-4890-aa0a-04f5e11305eb/volumes"
Jul 01 21:13:46.130914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.130878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:13:46.140496 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.140470    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"]
Jul 01 21:13:46.150184 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:46.150152    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:13:46.150184 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:13:46.150184 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:13:46.150184 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5" cmd=["/bin/sleep","15"]
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.150200    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" message="" err=<
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:46.150212    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerName="main" containerID="cri-o://93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5"
Jul 01 21:13:46.150386 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.150256    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerName="main" containerID="cri-o://93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5" gracePeriod=60
Jul 01 21:13:46.224562 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.224532    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:13:46.403576 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.403548    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:13:46.562685 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562658    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h6ql\" (UniqueName: \"kubernetes.io/projected/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kube-api-access-2h6ql\") pod \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") "
Jul 01 21:13:46.562856 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562700    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tls-certs\") pod \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") "
Jul 01 21:13:46.562856 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562777    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tokenizer-uds\") pod \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") "
Jul 01 21:13:46.562856 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562796    2569 generic.go:356] "Generic (PLEG): container finished" podID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerID="93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5" exitCode=0
Jul 01 21:13:46.562856 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562849    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kserve-provision-location\") pod \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\" (UID: \"6b06a717-1696-48d1-85ff-2ed9d75b4d1c\") "
Jul 01 21:13:46.563108 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" event={"ID":"6b06a717-1696-48d1-85ff-2ed9d75b4d1c","Type":"ContainerDied","Data":"93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5"}
Jul 01 21:13:46.563108 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562944    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw" event={"ID":"6b06a717-1696-48d1-85ff-2ed9d75b4d1c","Type":"ContainerDied","Data":"d59104881e9d82c83d368f430c838deb4af49edb94a3241e35deb768a34efbb2"}
Jul 01 21:13:46.563108 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562966    2569 scope.go:117] "RemoveContainer" containerID="93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5"
Jul 01 21:13:46.563108 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.562982    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"
Jul 01 21:13:46.563289 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.563106    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6b06a717-1696-48d1-85ff-2ed9d75b4d1c" (UID: "6b06a717-1696-48d1-85ff-2ed9d75b4d1c"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:13:46.563683 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.563657    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6b06a717-1696-48d1-85ff-2ed9d75b4d1c" (UID: "6b06a717-1696-48d1-85ff-2ed9d75b4d1c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:13:46.565026 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.564978    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b06a717-1696-48d1-85ff-2ed9d75b4d1c" (UID: "6b06a717-1696-48d1-85ff-2ed9d75b4d1c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:13:46.565132 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.565116    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kube-api-access-2h6ql" (OuterVolumeSpecName: "kube-api-access-2h6ql") pod "6b06a717-1696-48d1-85ff-2ed9d75b4d1c" (UID: "6b06a717-1696-48d1-85ff-2ed9d75b4d1c"). InnerVolumeSpecName "kube-api-access-2h6ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:13:46.582776 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.582757    2569 scope.go:117] "RemoveContainer" containerID="f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39"
Jul 01 21:13:46.590566 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.590531    2569 scope.go:117] "RemoveContainer" containerID="93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5"
Jul 01 21:13:46.590806 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:46.590782    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5\": container with ID starting with 93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5 not found: ID does not exist" containerID="93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5"
Jul 01 21:13:46.590893 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.590817    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5"} err="failed to get container status \"93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5\": rpc error: code = NotFound desc = could not find container \"93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5\": container with ID starting with 93647cfb8107e08706aa44739be00fc65bbe97a989a9ce0641d5176c93dbfcc5 not found: ID does not exist"
Jul 01 21:13:46.590893 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.590840    2569 scope.go:117] "RemoveContainer" containerID="f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39"
Jul 01 21:13:46.591099 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:13:46.591070    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39\": container with ID starting with f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39 not found: ID does not exist" containerID="f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39"
Jul 01 21:13:46.591159 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.591108    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39"} err="failed to get container status \"f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39\": rpc error: code = NotFound desc = could not find container \"f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39\": container with ID starting with f035b0591c83d6aacd599ac64d2f2f4de3e3c718dacd3c5c8ab696e6784f2f39 not found: ID does not exist"
Jul 01 21:13:46.664350 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.664294    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:46.664350 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.664315    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:46.664350 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.664330    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:46.664350 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.664341    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h6ql\" (UniqueName: \"kubernetes.io/projected/6b06a717-1696-48d1-85ff-2ed9d75b4d1c-kube-api-access-2h6ql\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:13:46.890281 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.890244    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"]
Jul 01 21:13:46.891959 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.891937    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw"]
Jul 01 21:13:46.964636 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:46.964584    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" path="/var/lib/kubelet/pods/6b06a717-1696-48d1-85ff-2ed9d75b4d1c/volumes"
Jul 01 21:13:57.937907 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:57.937870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:13:58.044076 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:58.044050    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:13:58.144174 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:13:58.144150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:00.502786 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:00.502752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:00.564730 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:00.564701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:01.008380 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008346    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"]
Jul 01 21:14:01.008765 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008749    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" containerName="main"
Jul 01 21:14:01.008812 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008767    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" containerName="main"
Jul 01 21:14:01.008812 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008782    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerName="main"
Jul 01 21:14:01.008812 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008788    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerName="main"
Jul 01 21:14:01.008812 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008800    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" containerName="storage-initializer"
Jul 01 21:14:01.008812 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008806    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" containerName="storage-initializer"
Jul 01 21:14:01.008812 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008813    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerName="storage-initializer"
Jul 01 21:14:01.009024 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008820    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerName="storage-initializer"
Jul 01 21:14:01.009024 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008896    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b06a717-1696-48d1-85ff-2ed9d75b4d1c" containerName="main"
Jul 01 21:14:01.009024 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.008904    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e937707f-1529-4890-aa0a-04f5e11305eb" containerName="main"
Jul 01 21:14:01.013417 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.013397    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:01.016440 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.016416    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:14:01.018975 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.018948    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"]
Jul 01 21:14:01.067743 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.067722    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:01.171294 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.171267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs6pz\" (UniqueName: \"kubernetes.io/projected/2fd3b08b-9cdb-4268-a66e-145e8b644134-kube-api-access-vs6pz\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") " pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:01.272045 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.271962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs6pz\" (UniqueName: \"kubernetes.io/projected/2fd3b08b-9cdb-4268-a66e-145e8b644134-kube-api-access-vs6pz\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") " pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:01.280617 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:01.280591    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs6pz\" (UniqueName: \"kubernetes.io/projected/2fd3b08b-9cdb-4268-a66e-145e8b644134-kube-api-access-vs6pz\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") " pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:07.731238 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:07.731188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") " pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:07.737887 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:07.737859    2569 operation_generator.go:1469] "Controller attach succeeded for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") device path: \"\"" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:07.832505 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:07.832470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") " pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:07.832919 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:07.832896    2569 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") DevicePath \"\"" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:07.836382 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:07.836356    2569 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") DevicePath \"csi-53e447ffbe8de97bd978ba79b6869c251d2b8083abed313ecd4ab91ba4f34998\"" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:08.083612 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:08.083579    2569 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/a7984d75592a60f75acc48715216990326d59cb841472d1b5739e644ba9a7d8d/globalmount\"" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:08.097844 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:08.097692    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"e2e-pvc-model-download-9dx26\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") " pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:08.225448 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:08.225418    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:08.385810 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:08.385780    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"]
Jul 01 21:14:08.387609 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:14:08.387579    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fd3b08b_9cdb_4268_a66e_145e8b644134.slice/crio-f5fe4adcafda75a6f7e336d282ed4d7800f8eaa4e1dea67e630617447f1bd99f WatchSource:0}: Error finding container f5fe4adcafda75a6f7e336d282ed4d7800f8eaa4e1dea67e630617447f1bd99f: Status 404 returned error can't find the container with id f5fe4adcafda75a6f7e336d282ed4d7800f8eaa4e1dea67e630617447f1bd99f
Jul 01 21:14:08.686558 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:08.686505    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26" event={"ID":"2fd3b08b-9cdb-4268-a66e-145e8b644134","Type":"ContainerStarted","Data":"5a0d299f8ba4ab8684656509671ef64e7dbc023c01e7c33dc2fce1ca6b8c756d"}
Jul 01 21:14:08.686558 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:08.686556    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26" event={"ID":"2fd3b08b-9cdb-4268-a66e-145e8b644134","Type":"ContainerStarted","Data":"f5fe4adcafda75a6f7e336d282ed4d7800f8eaa4e1dea67e630617447f1bd99f"}
Jul 01 21:14:08.702860 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:08.702799    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26" podStartSLOduration=11.702778311 podStartE2EDuration="11.702778311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 21:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:14:08.700943849 +0000 UTC m=+1654.296830163" watchObservedRunningTime="2026-07-01 21:14:08.702778311 +0000 UTC m=+1654.298664627"
Jul 01 21:14:15.729069 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:15.729034    2569 generic.go:356] "Generic (PLEG): container finished" podID="2fd3b08b-9cdb-4268-a66e-145e8b644134" containerID="5a0d299f8ba4ab8684656509671ef64e7dbc023c01e7c33dc2fce1ca6b8c756d" exitCode=0
Jul 01 21:14:15.729486 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:15.729107    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26" event={"ID":"2fd3b08b-9cdb-4268-a66e-145e8b644134","Type":"ContainerDied","Data":"5a0d299f8ba4ab8684656509671ef64e7dbc023c01e7c33dc2fce1ca6b8c756d"}
Jul 01 21:14:16.886105 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:16.886084    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:16.917562 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:16.917537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-storage\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") pod \"2fd3b08b-9cdb-4268-a66e-145e8b644134\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") "
Jul 01 21:14:16.917697 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:16.917582    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs6pz\" (UniqueName: \"kubernetes.io/projected/2fd3b08b-9cdb-4268-a66e-145e8b644134-kube-api-access-vs6pz\") pod \"2fd3b08b-9cdb-4268-a66e-145e8b644134\" (UID: \"2fd3b08b-9cdb-4268-a66e-145e8b644134\") "
Jul 01 21:14:16.919655 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:16.919631    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd3b08b-9cdb-4268-a66e-145e8b644134-kube-api-access-vs6pz" (OuterVolumeSpecName: "kube-api-access-vs6pz") pod "2fd3b08b-9cdb-4268-a66e-145e8b644134" (UID: "2fd3b08b-9cdb-4268-a66e-145e8b644134"). InnerVolumeSpecName "kube-api-access-vs6pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:14:16.921346 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:16.921326    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f" (OuterVolumeSpecName: "model-storage") pod "2fd3b08b-9cdb-4268-a66e-145e8b644134" (UID: "2fd3b08b-9cdb-4268-a66e-145e8b644134"). InnerVolumeSpecName "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Jul 01 21:14:17.019060 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:17.019004    2569 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") on node \"ip-10-0-132-117.ec2.internal\" "
Jul 01 21:14:17.019060 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:17.019032    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs6pz\" (UniqueName: \"kubernetes.io/projected/2fd3b08b-9cdb-4268-a66e-145e8b644134-kube-api-access-vs6pz\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:14:17.125352 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:17.125334    2569 operation_generator.go:895] UnmountDevice succeeded for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f") on node "ip-10-0-132-117.ec2.internal"
Jul 01 21:14:17.221229 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:17.221202    2569 reconciler_common.go:299] "Volume detached for volume \"pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed28fde6d0ee547f\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"csi-53e447ffbe8de97bd978ba79b6869c251d2b8083abed313ecd4ab91ba4f34998\""
Jul 01 21:14:17.740493 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:17.740461    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"
Jul 01 21:14:17.740621 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:17.740465    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/e2e-pvc-model-download-9dx26" event={"ID":"2fd3b08b-9cdb-4268-a66e-145e8b644134","Type":"ContainerDied","Data":"f5fe4adcafda75a6f7e336d282ed4d7800f8eaa4e1dea67e630617447f1bd99f"}
Jul 01 21:14:17.740621 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:17.740579    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5fe4adcafda75a6f7e336d282ed4d7800f8eaa4e1dea67e630617447f1bd99f"
Jul 01 21:14:21.814974 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:21.814933    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:22.280612 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:22.280579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:22.384146 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:22.384109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:35.071594 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:35.071566    2569 scope.go:117] "RemoveContainer" containerID="28f780f5c392900ed4949113a80eaf5e93c7ad048cea7b93cc8b6ed3c5cc7447"
Jul 01 21:14:35.079788 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:35.079771    2569 scope.go:117] "RemoveContainer" containerID="43c8dc1943908a60091f9f6307e2b63ddcc0197fae3807e80fd80af9b75d967f"
Jul 01 21:14:45.618680 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:45.618642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:45.674448 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:45.674424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:52.269282 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:52.269254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:14:52.587548 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:14:52.587519    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:15:15.059444 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:15:15.059412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:16:34.931445 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:16:34.931411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:16:35.013181 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:16:35.013148    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:16:35.019910 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:16:35.019891    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:16:40.326820 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:16:40.326777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:16:40.442527 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:16:40.442494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:06.587313 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.587279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:06.825411 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.825379    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"]
Jul 01 21:17:06.825942 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.825921    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd3b08b-9cdb-4268-a66e-145e8b644134" containerName="storage-initializer"
Jul 01 21:17:06.825942 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.825942    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd3b08b-9cdb-4268-a66e-145e8b644134" containerName="storage-initializer"
Jul 01 21:17:06.826155 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.826060    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd3b08b-9cdb-4268-a66e-145e8b644134" containerName="storage-initializer"
Jul 01 21:17:06.829463 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.829442    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:06.835536 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.835512    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa-dockercfg-d6gbb\""
Jul 01 21:17:06.835672 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.835513    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs\""
Jul 01 21:17:06.835672 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.835513    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 21:17:06.835672 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.835513    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:17:06.842970 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.842917    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"]
Jul 01 21:17:06.883082 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.883055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:06.912298 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.912271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77bpv\" (UniqueName: \"kubernetes.io/projected/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kube-api-access-77bpv\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:06.912389 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.912335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kserve-provision-location\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:06.912389 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.912385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tokenizer-uds\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:06.912475 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:06.912421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.013172 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.013146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kserve-provision-location\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.013320 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.013181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tokenizer-uds\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.013320 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.013212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.013320 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.013255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77bpv\" (UniqueName: \"kubernetes.io/projected/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kube-api-access-77bpv\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.013593 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.013567    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kserve-provision-location\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.013697 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.013629    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tokenizer-uds\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.015684 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.015663    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.023764 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.023740    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77bpv\" (UniqueName: \"kubernetes.io/projected/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kube-api-access-77bpv\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") " pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.139686 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.139609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:07.278766 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.278740    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"]
Jul 01 21:17:07.279780 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:17:07.279757    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6ed304_19d8_44ea_bf33_dae9113a1f96.slice/crio-27a66bf1d1962334f757a8840c1dec001595c8dfb45e6f9583eb2fdc78d11576 WatchSource:0}: Error finding container 27a66bf1d1962334f757a8840c1dec001595c8dfb45e6f9583eb2fdc78d11576: Status 404 returned error can't find the container with id 27a66bf1d1962334f757a8840c1dec001595c8dfb45e6f9583eb2fdc78d11576
Jul 01 21:17:07.645785 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.645741    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" event={"ID":"5a6ed304-19d8-44ea-bf33-dae9113a1f96","Type":"ContainerStarted","Data":"d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de"}
Jul 01 21:17:07.646202 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:07.645793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" event={"ID":"5a6ed304-19d8-44ea-bf33-dae9113a1f96","Type":"ContainerStarted","Data":"27a66bf1d1962334f757a8840c1dec001595c8dfb45e6f9583eb2fdc78d11576"}
Jul 01 21:17:08.651878 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:08.651841    2569 generic.go:356] "Generic (PLEG): container finished" podID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerID="d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de" exitCode=0
Jul 01 21:17:08.652353 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:08.651900    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" event={"ID":"5a6ed304-19d8-44ea-bf33-dae9113a1f96","Type":"ContainerDied","Data":"d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de"}
Jul 01 21:17:09.659448 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:09.659412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" event={"ID":"5a6ed304-19d8-44ea-bf33-dae9113a1f96","Type":"ContainerStarted","Data":"4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31"}
Jul 01 21:17:09.659883 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:09.659561    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:09.693575 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:09.693526    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" podStartSLOduration=3.027033751 podStartE2EDuration="3.693510169s" totalImagesPullingTime="0s" totalInitContainerRuntime="666.476418ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:17:09.691449583 +0000 UTC m=+1835.287335890" watchObservedRunningTime="2026-07-01 21:17:09.693510169 +0000 UTC m=+1835.289396482"
Jul 01 21:17:22.565513 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:22.565479    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:24.443783 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:24.443754    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:24.524556 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:24.524521    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:40.666241 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:40.666208    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:17:56.491335 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:56.491261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:58.082323 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:58.082290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:17:59.594412 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:17:59.594373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:18:00.159162 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:18:00.159129    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:18:25.400045 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:18:25.399984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:19:12.269337 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:19:12.269303    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:19:12.369581 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:19:12.369549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:20:39.204933 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.204887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:20:39.258711 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.258679    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"]
Jul 01 21:20:39.268090 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:20:39.268055    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:20:39.268090 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:20:39.268090 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:20:39.268090 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31" cmd=["/bin/sleep","15"]
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.268102    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" message="" err=<
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:20:39.268114    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerName="main" containerID="cri-o://4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31"
Jul 01 21:20:39.268398 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.268157    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerName="main" containerID="cri-o://4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31" gracePeriod=60
Jul 01 21:20:39.393507 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.393473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:20:39.527951 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.527930    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:20:39.638554 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.638528    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77bpv\" (UniqueName: \"kubernetes.io/projected/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kube-api-access-77bpv\") pod \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") "
Jul 01 21:20:39.638693 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.638598    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tokenizer-uds\") pod \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") "
Jul 01 21:20:39.638693 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.638649    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kserve-provision-location\") pod \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") "
Jul 01 21:20:39.638693 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.638681    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tls-certs\") pod \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\" (UID: \"5a6ed304-19d8-44ea-bf33-dae9113a1f96\") "
Jul 01 21:20:39.638896 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.638874    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "5a6ed304-19d8-44ea-bf33-dae9113a1f96" (UID: "5a6ed304-19d8-44ea-bf33-dae9113a1f96"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:20:39.639263 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.638956    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:20:39.639351 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.639297    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5a6ed304-19d8-44ea-bf33-dae9113a1f96" (UID: "5a6ed304-19d8-44ea-bf33-dae9113a1f96"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:20:39.640664 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.640608    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kube-api-access-77bpv" (OuterVolumeSpecName: "kube-api-access-77bpv") pod "5a6ed304-19d8-44ea-bf33-dae9113a1f96" (UID: "5a6ed304-19d8-44ea-bf33-dae9113a1f96"). InnerVolumeSpecName "kube-api-access-77bpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:20:39.640773 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.640670    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a6ed304-19d8-44ea-bf33-dae9113a1f96" (UID: "5a6ed304-19d8-44ea-bf33-dae9113a1f96"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:20:39.739448 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.739426    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:20:39.739548 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.739450    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6ed304-19d8-44ea-bf33-dae9113a1f96-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:20:39.739548 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.739461    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77bpv\" (UniqueName: \"kubernetes.io/projected/5a6ed304-19d8-44ea-bf33-dae9113a1f96-kube-api-access-77bpv\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:20:39.769965 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.769898    2569 generic.go:356] "Generic (PLEG): container finished" podID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerID="4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31" exitCode=0
Jul 01 21:20:39.770070 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.769967    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"
Jul 01 21:20:39.770070 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.769981    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" event={"ID":"5a6ed304-19d8-44ea-bf33-dae9113a1f96","Type":"ContainerDied","Data":"4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31"}
Jul 01 21:20:39.770146 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.770084    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc" event={"ID":"5a6ed304-19d8-44ea-bf33-dae9113a1f96","Type":"ContainerDied","Data":"27a66bf1d1962334f757a8840c1dec001595c8dfb45e6f9583eb2fdc78d11576"}
Jul 01 21:20:39.770146 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.770110    2569 scope.go:117] "RemoveContainer" containerID="4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31"
Jul 01 21:20:39.779939 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.779922    2569 scope.go:117] "RemoveContainer" containerID="d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de"
Jul 01 21:20:39.787659 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.787643    2569 scope.go:117] "RemoveContainer" containerID="4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31"
Jul 01 21:20:39.787866 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:20:39.787848    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31\": container with ID starting with 4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31 not found: ID does not exist" containerID="4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31"
Jul 01 21:20:39.787938 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.787877    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31"} err="failed to get container status \"4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31\": rpc error: code = NotFound desc = could not find container \"4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31\": container with ID starting with 4b235132e0bf6a7c3ae1f27af070856ef559863d7d6a994cc658384296623d31 not found: ID does not exist"
Jul 01 21:20:39.787938 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.787900    2569 scope.go:117] "RemoveContainer" containerID="d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de"
Jul 01 21:20:39.788175 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:20:39.788157    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de\": container with ID starting with d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de not found: ID does not exist" containerID="d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de"
Jul 01 21:20:39.788215 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.788181    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de"} err="failed to get container status \"d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de\": rpc error: code = NotFound desc = could not find container \"d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de\": container with ID starting with d0740342e0f5af82176d20394572a04dd16ae9f7d7256efa649094a04c7e54de not found: ID does not exist"
Jul 01 21:20:39.809392 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.809373    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"]
Jul 01 21:20:39.815510 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:39.815491    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc"]
Jul 01 21:20:40.965360 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:20:40.965326    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" path="/var/lib/kubelet/pods/5a6ed304-19d8-44ea-bf33-dae9113a1f96/volumes"
Jul 01 21:21:06.217266 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.217193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:06.425845 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.425806    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"]
Jul 01 21:21:06.426251 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.426233    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerName="storage-initializer"
Jul 01 21:21:06.426251 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.426250    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerName="storage-initializer"
Jul 01 21:21:06.426415 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.426272    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerName="main"
Jul 01 21:21:06.426415 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.426278    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerName="main"
Jul 01 21:21:06.426415 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.426330    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a6ed304-19d8-44ea-bf33-dae9113a1f96" containerName="main"
Jul 01 21:21:06.431101 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.431081    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.434480 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.434464    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 21:21:06.434704 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.434690    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-epp-sa-dockercfg-f857h\""
Jul 01 21:21:06.435545 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.435516    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:21:06.435545 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.435528    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
Jul 01 21:21:06.449295 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.449268    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"]
Jul 01 21:21:06.473290 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.473233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:06.554304 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.554276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.554418 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.554316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qlsj\" (UniqueName: \"kubernetes.io/projected/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kube-api-access-5qlsj\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.554418 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.554337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.554418 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.554402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.655713 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.655684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.655844 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.655726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qlsj\" (UniqueName: \"kubernetes.io/projected/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kube-api-access-5qlsj\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.655844 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.655744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.655844 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.655775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.656169 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.656150    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.656234 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.656203    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.658243 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.658224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.669935 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.669915    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qlsj\" (UniqueName: \"kubernetes.io/projected/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kube-api-access-5qlsj\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.740666 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.740612    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:06.882446 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.882412    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"]
Jul 01 21:21:06.883656 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:21:06.883617    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f6e595_c7db_4e4d_bd1a_e1bc864f94c8.slice/crio-4abf0c6c884fc99fd9c55d407d8b369d1adaf42da5be6bec0bffc0e490773297 WatchSource:0}: Error finding container 4abf0c6c884fc99fd9c55d407d8b369d1adaf42da5be6bec0bffc0e490773297: Status 404 returned error can't find the container with id 4abf0c6c884fc99fd9c55d407d8b369d1adaf42da5be6bec0bffc0e490773297
Jul 01 21:21:06.917665 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:06.917633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" event={"ID":"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8","Type":"ContainerStarted","Data":"4abf0c6c884fc99fd9c55d407d8b369d1adaf42da5be6bec0bffc0e490773297"}
Jul 01 21:21:07.924662 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:07.924587    2569 generic.go:356] "Generic (PLEG): container finished" podID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerID="13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756" exitCode=0
Jul 01 21:21:07.925018 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:07.924675    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" event={"ID":"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8","Type":"ContainerDied","Data":"13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756"}
Jul 01 21:21:08.932553 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:08.932523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" event={"ID":"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8","Type":"ContainerStarted","Data":"2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad"}
Jul 01 21:21:08.932930 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:08.932616    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:08.962238 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:08.962190    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" podStartSLOduration=2.27303434 podStartE2EDuration="2.96217679s" totalImagesPullingTime="0s" totalInitContainerRuntime="689.14245ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:21:08.957909911 +0000 UTC m=+2074.553796226" watchObservedRunningTime="2026-07-01 21:21:08.96217679 +0000 UTC m=+2074.558063103"
Jul 01 21:21:18.017429 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:18.017394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:27.852597 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:27.852567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:27.924106 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:27.924068    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:35.052394 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:35.052368    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:21:35.060803 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:35.060782    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:21:39.939716 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:39.939688    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:21:57.696346 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:57.696312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:57.795058 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:57.795025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:57.897041 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:57.896986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:21:58.101285 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:21:58.101254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:22:05.742674 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:22:05.742641    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:22:12.368829 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:22:12.368797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:25:45.869543 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:45.869508    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"]
Jul 01 21:25:45.878942 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:25:45.878905    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:25:45.878942 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:25:45.878942 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:25:45.878942 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad" cmd=["/bin/sleep","15"]
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:45.878970    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" message="" err=<
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:25:45.878988    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerName="main" containerID="cri-o://2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad"
Jul 01 21:25:45.879233 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:45.879079    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerName="main" containerID="cri-o://2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad" gracePeriod=60
Jul 01 21:25:45.896285 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:45.896259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:25:46.140897 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.140876    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:25:46.164068 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.164044    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tls-certs\") pod \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") "
Jul 01 21:25:46.164181 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.164091    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qlsj\" (UniqueName: \"kubernetes.io/projected/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kube-api-access-5qlsj\") pod \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") "
Jul 01 21:25:46.164181 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.164120    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kserve-provision-location\") pod \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") "
Jul 01 21:25:46.164288 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.164233    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tokenizer-uds\") pod \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\" (UID: \"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8\") "
Jul 01 21:25:46.164528 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.164494    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" (UID: "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:25:46.164954 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.164921    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" (UID: "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:25:46.166349 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.166327    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" (UID: "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:25:46.166477 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.166452    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kube-api-access-5qlsj" (OuterVolumeSpecName: "kube-api-access-5qlsj") pod "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" (UID: "b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8"). InnerVolumeSpecName "kube-api-access-5qlsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:25:46.265520 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.265487    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:25:46.265520 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.265513    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:25:46.265667 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.265527    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qlsj\" (UniqueName: \"kubernetes.io/projected/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kube-api-access-5qlsj\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:25:46.265667 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.265541    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:25:46.407352 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.407277    2569 generic.go:356] "Generic (PLEG): container finished" podID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerID="2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad" exitCode=0
Jul 01 21:25:46.407352 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.407330    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"
Jul 01 21:25:46.407508 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.407359    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" event={"ID":"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8","Type":"ContainerDied","Data":"2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad"}
Jul 01 21:25:46.407508 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.407415    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx" event={"ID":"b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8","Type":"ContainerDied","Data":"4abf0c6c884fc99fd9c55d407d8b369d1adaf42da5be6bec0bffc0e490773297"}
Jul 01 21:25:46.407508 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.407438    2569 scope.go:117] "RemoveContainer" containerID="2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad"
Jul 01 21:25:46.417722 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.417693    2569 scope.go:117] "RemoveContainer" containerID="13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756"
Jul 01 21:25:46.425538 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.425523    2569 scope.go:117] "RemoveContainer" containerID="2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad"
Jul 01 21:25:46.425805 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:25:46.425787    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad\": container with ID starting with 2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad not found: ID does not exist" containerID="2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad"
Jul 01 21:25:46.425865 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.425811    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad"} err="failed to get container status \"2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad\": rpc error: code = NotFound desc = could not find container \"2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad\": container with ID starting with 2a5433416b45d0beccbad8402175f4d98cd31795a1053844e99d401c7fdf1dad not found: ID does not exist"
Jul 01 21:25:46.425865 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.425827    2569 scope.go:117] "RemoveContainer" containerID="13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756"
Jul 01 21:25:46.426070 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:25:46.426052    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756\": container with ID starting with 13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756 not found: ID does not exist" containerID="13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756"
Jul 01 21:25:46.426120 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.426076    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756"} err="failed to get container status \"13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756\": rpc error: code = NotFound desc = could not find container \"13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756\": container with ID starting with 13622798ca2cbc32211a465d07b09f83bb56ca6cdee88b8aa4549f0ac2213756 not found: ID does not exist"
Jul 01 21:25:46.431921 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.431900    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"]
Jul 01 21:25:46.435520 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.435499    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx"]
Jul 01 21:25:46.964811 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:46.964780    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" path="/var/lib/kubelet/pods/b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8/volumes"
Jul 01 21:25:47.607499 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:25:47.607461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:06.651753 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.651720    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"]
Jul 01 21:26:06.652172 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.652154    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerName="storage-initializer"
Jul 01 21:26:06.652215 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.652175    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerName="storage-initializer"
Jul 01 21:26:06.652215 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.652185    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerName="main"
Jul 01 21:26:06.652215 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.652191    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerName="main"
Jul 01 21:26:06.652313 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.652265    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f6e595-c7db-4e4d-bd1a-e1bc864f94c8" containerName="main"
Jul 01 21:26:06.656695 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.656675    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.659173 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.659153    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-hltmd\""
Jul 01 21:26:06.667066 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.667043    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"]
Jul 01 21:26:06.684869 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.684838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:06.727167 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727277 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c36b962-8108-4be6-a733-4f58cc918914-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727277 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727195    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gtm7\" (UniqueName: \"kubernetes.io/projected/4c36b962-8108-4be6-a733-4f58cc918914-kube-api-access-5gtm7\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727277 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727228    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c36b962-8108-4be6-a733-4f58cc918914-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727277 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727457 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727457 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727457 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727394    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.727457 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.727410    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c36b962-8108-4be6-a733-4f58cc918914-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.784033 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.783983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:06.828325 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828453 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828453 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828453 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c36b962-8108-4be6-a733-4f58cc918914-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828453 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828691 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c36b962-8108-4be6-a733-4f58cc918914-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828691 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828510    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gtm7\" (UniqueName: \"kubernetes.io/projected/4c36b962-8108-4be6-a733-4f58cc918914-kube-api-access-5gtm7\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828691 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c36b962-8108-4be6-a733-4f58cc918914-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828691 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828896 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828723    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828896 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828759    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.828896 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.828880    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.829103 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.829028    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.829245 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.829227    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c36b962-8108-4be6-a733-4f58cc918914-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.831065 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.831041    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c36b962-8108-4be6-a733-4f58cc918914-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.831197 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.831179    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c36b962-8108-4be6-a733-4f58cc918914-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.836112 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.836087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gtm7\" (UniqueName: \"kubernetes.io/projected/4c36b962-8108-4be6-a733-4f58cc918914-kube-api-access-5gtm7\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.836207 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.836118    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c36b962-8108-4be6-a733-4f58cc918914-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-j47sj\" (UID: \"4c36b962-8108-4be6-a733-4f58cc918914\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:06.968826 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:06.968770    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:07.103479 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.103454    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"]
Jul 01 21:26:07.105303 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:26:07.105279    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c36b962_8108_4be6_a733_4f58cc918914.slice/crio-2e18917108743669886da276292f12253c91de27b97a830651dd4f96b937625e WatchSource:0}: Error finding container 2e18917108743669886da276292f12253c91de27b97a830651dd4f96b937625e: Status 404 returned error can't find the container with id 2e18917108743669886da276292f12253c91de27b97a830651dd4f96b937625e
Jul 01 21:26:07.107507 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.107465    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 21:26:07.107574 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.107544    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 21:26:07.107616 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.107574    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 21:26:07.526302 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.526267    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" event={"ID":"4c36b962-8108-4be6-a733-4f58cc918914","Type":"ContainerStarted","Data":"123c6ed2e7ca5be2c6fe9f77e8e3e781f0f838e02a9bbc22593b08887bd0fb4b"}
Jul 01 21:26:07.526481 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.526326    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" event={"ID":"4c36b962-8108-4be6-a733-4f58cc918914","Type":"ContainerStarted","Data":"2e18917108743669886da276292f12253c91de27b97a830651dd4f96b937625e"}
Jul 01 21:26:07.545846 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.545799    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" podStartSLOduration=1.545784803 podStartE2EDuration="1.545784803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 21:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:26:07.543880024 +0000 UTC m=+2373.139766341" watchObservedRunningTime="2026-07-01 21:26:07.545784803 +0000 UTC m=+2373.141671115"
Jul 01 21:26:07.969671 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:07.969640    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:08.974185 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:08.974159    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:09.537815 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:09.537781    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:09.538583 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:09.538563    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:10.141802 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:10.141762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:18.585907 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:18.585838    2569 generic.go:356] "Generic (PLEG): container finished" podID="4c36b962-8108-4be6-a733-4f58cc918914" containerID="123c6ed2e7ca5be2c6fe9f77e8e3e781f0f838e02a9bbc22593b08887bd0fb4b" exitCode=0
Jul 01 21:26:18.586289 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:18.585917    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" event={"ID":"4c36b962-8108-4be6-a733-4f58cc918914","Type":"ContainerDied","Data":"123c6ed2e7ca5be2c6fe9f77e8e3e781f0f838e02a9bbc22593b08887bd0fb4b"}
Jul 01 21:26:18.586289 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:18.586261    2569 scope.go:117] "RemoveContainer" containerID="123c6ed2e7ca5be2c6fe9f77e8e3e781f0f838e02a9bbc22593b08887bd0fb4b"
Jul 01 21:26:18.587173 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:18.587146    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 21:26:18.587248 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:18.587231    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 21:26:18.587291 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:18.587280    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 01 21:26:19.593381 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:19.593344    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" event={"ID":"4c36b962-8108-4be6-a733-4f58cc918914","Type":"ContainerStarted","Data":"cd0ba1edac15c4c324a1ca39b15cec41ea8dd88abf7105957be48eeedd4199bf"}
Jul 01 21:26:19.969205 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:19.969120    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:19.970339 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:19.970311    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" podUID="4c36b962-8108-4be6-a733-4f58cc918914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 01 21:26:20.969543 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:20.969507    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" podUID="4c36b962-8108-4be6-a733-4f58cc918914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 01 21:26:21.969171 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:21.969129    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" podUID="4c36b962-8108-4be6-a733-4f58cc918914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 01 21:26:22.969252 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:22.969210    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" podUID="4c36b962-8108-4be6-a733-4f58cc918914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 01 21:26:23.969780 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:23.969742    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj" podUID="4c36b962-8108-4be6-a733-4f58cc918914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 01 21:26:24.537839 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:24.537797    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:24.973304 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:24.973278    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:24.974205 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:24.974186    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj"
Jul 01 21:26:31.305892 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.305857    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:31.559798 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.559725    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"]
Jul 01 21:26:31.563323 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.563304    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.566858 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.566839    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 21:26:31.566858 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.566850    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-epp-sa-dockercfg-45czl\""
Jul 01 21:26:31.567662 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.567628    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:26:31.567780 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.567745    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-kserve-self-signed-certs\""
Jul 01 21:26:31.575173 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.575153    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"]
Jul 01 21:26:31.745081 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.745052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.745268 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.745109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.745268 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.745163    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cx8\" (UniqueName: \"kubernetes.io/projected/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kube-api-access-f6cx8\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.745268 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.745193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.757827 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.757803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:31.846474 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.846446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.846635 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.846508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.846635 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.846558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cx8\" (UniqueName: \"kubernetes.io/projected/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kube-api-access-f6cx8\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.846635 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.846595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.846914 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.846891    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.846978 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.846913    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.848959 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.848937    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.854080 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.854059    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cx8\" (UniqueName: \"kubernetes.io/projected/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kube-api-access-f6cx8\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:31.862398 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.862372    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:31.873404 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:31.873388    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:32.022386 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:32.022356    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"]
Jul 01 21:26:32.024537 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:26:32.024509    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351dd66b_5a5e_4dbc_935e_9cc21a4c4d29.slice/crio-59806a9007ead059ab03a3a5866bea530d7675615657a16a1b638d967318f257 WatchSource:0}: Error finding container 59806a9007ead059ab03a3a5866bea530d7675615657a16a1b638d967318f257: Status 404 returned error can't find the container with id 59806a9007ead059ab03a3a5866bea530d7675615657a16a1b638d967318f257
Jul 01 21:26:32.668560 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:32.668517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" event={"ID":"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29","Type":"ContainerStarted","Data":"cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b"}
Jul 01 21:26:32.668933 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:32.668619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" event={"ID":"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29","Type":"ContainerStarted","Data":"59806a9007ead059ab03a3a5866bea530d7675615657a16a1b638d967318f257"}
Jul 01 21:26:33.676870 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:33.676836    2569 generic.go:356] "Generic (PLEG): container finished" podID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerID="cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b" exitCode=0
Jul 01 21:26:33.677331 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:33.676927    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" event={"ID":"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29","Type":"ContainerDied","Data":"cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b"}
Jul 01 21:26:34.684043 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:34.684007    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" event={"ID":"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29","Type":"ContainerStarted","Data":"ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476"}
Jul 01 21:26:34.684392 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:34.684069    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:26:34.702431 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:34.702376    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" podStartSLOduration=3.02023345 podStartE2EDuration="3.702356943s" totalImagesPullingTime="0s" totalInitContainerRuntime="682.123493ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:26:34.701574271 +0000 UTC m=+2400.297460585" watchObservedRunningTime="2026-07-01 21:26:34.702356943 +0000 UTC m=+2400.298243260"
Jul 01 21:26:35.087763 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:35.087734    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:26:35.097866 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:35.097845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:26:42.488156 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:42.488121    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:26:42.548071 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:26:42.548046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:27:05.697407 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:27:05.697319    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:28:01.597191 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:01.597151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:28:01.697193 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:01.697163    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:28:45.272241 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.272136    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:28:45.451871 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.451836    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"]
Jul 01 21:28:45.455965 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.455944    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.458317 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.458294    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-epp-sa-dockercfg-5q9g5\""
Jul 01 21:28:45.459028 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.459010    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
Jul 01 21:28:45.462681 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.462659    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"]
Jul 01 21:28:45.476068 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.476044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:28:45.593201 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.593167    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.593393 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.593210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkjhh\" (UniqueName: \"kubernetes.io/projected/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kube-api-access-zkjhh\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.593393 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.593315    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.593503 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.593387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.694415 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.694390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.694562 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.694437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.694562 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.694480    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.694562 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.694504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkjhh\" (UniqueName: \"kubernetes.io/projected/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kube-api-access-zkjhh\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.694881 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.694858    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.694944 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.694897    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.697096 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.697069    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.701457 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.701432    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkjhh\" (UniqueName: \"kubernetes.io/projected/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kube-api-access-zkjhh\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.766846 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.766810    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:45.913884 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:45.913854    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"]
Jul 01 21:28:45.914815 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:28:45.914789    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7c4c9f_aeef_46c0_bcaa_309f3ac0f28b.slice/crio-f64b5d03bacdc87f667cfb5f94b4b4311a0f9362f747eb1db22e224c2b62e259 WatchSource:0}: Error finding container f64b5d03bacdc87f667cfb5f94b4b4311a0f9362f747eb1db22e224c2b62e259: Status 404 returned error can't find the container with id f64b5d03bacdc87f667cfb5f94b4b4311a0f9362f747eb1db22e224c2b62e259
Jul 01 21:28:46.444289 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:46.444254    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" event={"ID":"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b","Type":"ContainerStarted","Data":"159e77c5b3eb4b05238548a46aecc2f07c1ee1bf6370e126f328120a28b57763"}
Jul 01 21:28:46.444654 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:46.444310    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" event={"ID":"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b","Type":"ContainerStarted","Data":"f64b5d03bacdc87f667cfb5f94b4b4311a0f9362f747eb1db22e224c2b62e259"}
Jul 01 21:28:47.451191 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:47.451161    2569 generic.go:356] "Generic (PLEG): container finished" podID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerID="159e77c5b3eb4b05238548a46aecc2f07c1ee1bf6370e126f328120a28b57763" exitCode=0
Jul 01 21:28:47.451576 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:47.451246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" event={"ID":"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b","Type":"ContainerDied","Data":"159e77c5b3eb4b05238548a46aecc2f07c1ee1bf6370e126f328120a28b57763"}
Jul 01 21:28:48.459653 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:48.459613    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" event={"ID":"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b","Type":"ContainerStarted","Data":"9b4486b09435b87273acfd63c2dfe62393a5c5471a52233b9a775237d85ec869"}
Jul 01 21:28:48.460067 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:48.459846    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:28:48.481290 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:48.481235    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" podStartSLOduration=2.828432941 podStartE2EDuration="3.481220054s" totalImagesPullingTime="0s" totalInitContainerRuntime="652.787113ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:28:48.47920434 +0000 UTC m=+2534.075090655" watchObservedRunningTime="2026-07-01 21:28:48.481220054 +0000 UTC m=+2534.077106367"
Jul 01 21:28:54.379849 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:28:54.379815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:29:06.289016 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:06.288959    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:29:19.466350 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:19.466319    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:29:20.980493 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:20.980459    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"]
Jul 01 21:29:20.983114 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:20.983083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:29:20.990329 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:29:20.990298    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:29:20.990329 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:29:20.990329 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:29:20.990329 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476" cmd=["/bin/sleep","15"]
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:20.990343    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" message="" err=<
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:29:20.990355    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerName="main" containerID="cri-o://ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476"
Jul 01 21:29:20.990536 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:20.990389    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerName="main" containerID="cri-o://ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476" gracePeriod=60
Jul 01 21:29:21.039536 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.039510    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:29:21.253111 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.253090    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:29:21.359814 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.359784    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6cx8\" (UniqueName: \"kubernetes.io/projected/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kube-api-access-f6cx8\") pod \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") "
Jul 01 21:29:21.359971 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.359829    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tokenizer-uds\") pod \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") "
Jul 01 21:29:21.359971 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.359880    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kserve-provision-location\") pod \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") "
Jul 01 21:29:21.359971 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.359951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tls-certs\") pod \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\" (UID: \"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29\") "
Jul 01 21:29:21.360193 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.360171    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" (UID: "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:29:21.360597 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.360572    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" (UID: "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:29:21.361909 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.361884    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" (UID: "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:29:21.362002 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.361974    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kube-api-access-f6cx8" (OuterVolumeSpecName: "kube-api-access-f6cx8") pod "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" (UID: "351dd66b-5a5e-4dbc-935e-9cc21a4c4d29"). InnerVolumeSpecName "kube-api-access-f6cx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:29:21.460911 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.460881    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:29:21.460911 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.460907    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6cx8\" (UniqueName: \"kubernetes.io/projected/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kube-api-access-f6cx8\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:29:21.460911 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.460919    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:29:21.461167 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.460928    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:29:21.645207 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.645172    2569 generic.go:356] "Generic (PLEG): container finished" podID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerID="ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476" exitCode=0
Jul 01 21:29:21.645393 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.645222    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"
Jul 01 21:29:21.645393 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.645239    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" event={"ID":"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29","Type":"ContainerDied","Data":"ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476"}
Jul 01 21:29:21.645393 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.645290    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr" event={"ID":"351dd66b-5a5e-4dbc-935e-9cc21a4c4d29","Type":"ContainerDied","Data":"59806a9007ead059ab03a3a5866bea530d7675615657a16a1b638d967318f257"}
Jul 01 21:29:21.645393 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.645313    2569 scope.go:117] "RemoveContainer" containerID="ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476"
Jul 01 21:29:21.655345 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.655323    2569 scope.go:117] "RemoveContainer" containerID="cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b"
Jul 01 21:29:21.663186 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.663170    2569 scope.go:117] "RemoveContainer" containerID="ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476"
Jul 01 21:29:21.663435 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:29:21.663415    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476\": container with ID starting with ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476 not found: ID does not exist" containerID="ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476"
Jul 01 21:29:21.663518 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.663448    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476"} err="failed to get container status \"ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476\": rpc error: code = NotFound desc = could not find container \"ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476\": container with ID starting with ecd545f2d14578dc44cbde00f397ec6ff68facbaecbf47061cf2ecfd39e90476 not found: ID does not exist"
Jul 01 21:29:21.663518 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.663469    2569 scope.go:117] "RemoveContainer" containerID="cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b"
Jul 01 21:29:21.663689 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:29:21.663667    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b\": container with ID starting with cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b not found: ID does not exist" containerID="cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b"
Jul 01 21:29:21.663729 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.663696    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b"} err="failed to get container status \"cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b\": rpc error: code = NotFound desc = could not find container \"cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b\": container with ID starting with cc29d93c720733283deb579c02f76002d418b6c82863f830fbb22e2cf828131b not found: ID does not exist"
Jul 01 21:29:21.668350 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.668329    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"]
Jul 01 21:29:21.672140 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:21.672119    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr"]
Jul 01 21:29:22.966414 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:22.966380    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" path="/var/lib/kubelet/pods/351dd66b-5a5e-4dbc-935e-9cc21a4c4d29/volumes"
Jul 01 21:29:47.362035 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:29:47.361989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:30:08.907317 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:30:08.907241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:30:46.849691 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:30:46.849653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:31:13.049253 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.049218    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"]
Jul 01 21:31:13.059337 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:31:13.059306    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:31:13.059337 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:31:13.059337 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:31:13.059337 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="9b4486b09435b87273acfd63c2dfe62393a5c5471a52233b9a775237d85ec869" cmd=["/bin/sleep","15"]
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.059348    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" message="" err=<
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:31:13.059363    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerName="main" containerID="cri-o://9b4486b09435b87273acfd63c2dfe62393a5c5471a52233b9a775237d85ec869"
Jul 01 21:31:13.059608 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.059394    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerName="main" containerID="cri-o://9b4486b09435b87273acfd63c2dfe62393a5c5471a52233b9a775237d85ec869" gracePeriod=60
Jul 01 21:31:13.078125 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.078099    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:31:13.255051 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.254979    2569 generic.go:356] "Generic (PLEG): container finished" podID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerID="9b4486b09435b87273acfd63c2dfe62393a5c5471a52233b9a775237d85ec869" exitCode=0
Jul 01 21:31:13.255189 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.255040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" event={"ID":"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b","Type":"ContainerDied","Data":"9b4486b09435b87273acfd63c2dfe62393a5c5471a52233b9a775237d85ec869"}
Jul 01 21:31:13.324277 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.324257    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:31:13.354538 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.354517    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tokenizer-uds\") pod \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") "
Jul 01 21:31:13.354678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.354594    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kserve-provision-location\") pod \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") "
Jul 01 21:31:13.354678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.354618    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkjhh\" (UniqueName: \"kubernetes.io/projected/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kube-api-access-zkjhh\") pod \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") "
Jul 01 21:31:13.354678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.354639    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tls-certs\") pod \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\" (UID: \"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b\") "
Jul 01 21:31:13.354848 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.354781    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" (UID: "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:31:13.355035 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.355019    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:31:13.355394 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.355371    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" (UID: "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:31:13.356617 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.356592    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kube-api-access-zkjhh" (OuterVolumeSpecName: "kube-api-access-zkjhh") pod "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" (UID: "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b"). InnerVolumeSpecName "kube-api-access-zkjhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:31:13.356726 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.356671    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" (UID: "ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:31:13.456222 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.456199    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:31:13.456320 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.456218    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkjhh\" (UniqueName: \"kubernetes.io/projected/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-kube-api-access-zkjhh\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:31:13.456320 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:13.456239    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:31:14.126657 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.126604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:31:14.262559 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.262530    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"
Jul 01 21:31:14.262559 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.262545    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44" event={"ID":"ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b","Type":"ContainerDied","Data":"f64b5d03bacdc87f667cfb5f94b4b4311a0f9362f747eb1db22e224c2b62e259"}
Jul 01 21:31:14.262743 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.262602    2569 scope.go:117] "RemoveContainer" containerID="9b4486b09435b87273acfd63c2dfe62393a5c5471a52233b9a775237d85ec869"
Jul 01 21:31:14.276530 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.276499    2569 scope.go:117] "RemoveContainer" containerID="159e77c5b3eb4b05238548a46aecc2f07c1ee1bf6370e126f328120a28b57763"
Jul 01 21:31:14.288905 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.288874    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"]
Jul 01 21:31:14.292034 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.292011    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44"]
Jul 01 21:31:14.964869 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:14.964839    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" path="/var/lib/kubelet/pods/ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b/volumes"
Jul 01 21:31:17.178539 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:17.178508    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:31:22.816797 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:22.816762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:31:23.006736 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.006704    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"]
Jul 01 21:31:23.007430 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007403    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerName="storage-initializer"
Jul 01 21:31:23.007430 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007430    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerName="storage-initializer"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007444    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerName="main"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007452    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerName="main"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007506    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerName="storage-initializer"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007516    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerName="storage-initializer"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007526    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerName="main"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007534    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerName="main"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007625    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab7c4c9f-aeef-46c0-bcaa-309f3ac0f28b" containerName="main"
Jul 01 21:31:23.007651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.007640    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="351dd66b-5a5e-4dbc-935e-9cc21a4c4d29" containerName="main"
Jul 01 21:31:23.011233 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.011213    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.013393 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.013372    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 21:31:23.014345 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.014318    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:31:23.014533 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.014347    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-epp-sa-dockercfg-kv67h\""
Jul 01 21:31:23.014640 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.014359    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
Jul 01 21:31:23.023810 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.023787    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"]
Jul 01 21:31:23.048669 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.048633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:31:23.122817 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.122783    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.122927 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.122818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.122927 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.122836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.122927 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.122912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxtk6\" (UniqueName: \"kubernetes.io/projected/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kube-api-access-wxtk6\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.223371 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.223338    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.223371 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.223375    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.223604 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.223392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.223604 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.223428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxtk6\" (UniqueName: \"kubernetes.io/projected/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kube-api-access-wxtk6\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.223717 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.223678    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.223782 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.223728    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.225958 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.225930    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.231180 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.231161    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxtk6\" (UniqueName: \"kubernetes.io/projected/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kube-api-access-wxtk6\") pod \"stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.323981 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.323953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:23.465396 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:23.465373    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"]
Jul 01 21:31:23.466420 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:31:23.466400    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9846e5_71bf_4bb7_8c16_750102dcd26d.slice/crio-2861bc725c26d51538adfab458fb567b1cd3e737a7506f4a301fa87b470ea4fa WatchSource:0}: Error finding container 2861bc725c26d51538adfab458fb567b1cd3e737a7506f4a301fa87b470ea4fa: Status 404 returned error can't find the container with id 2861bc725c26d51538adfab458fb567b1cd3e737a7506f4a301fa87b470ea4fa
Jul 01 21:31:24.316150 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:24.316117    2569 generic.go:356] "Generic (PLEG): container finished" podID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerID="5c50e156a964fbac52bc8c067e55bfcf9596260a35f93eb907c99a6eb6301eb3" exitCode=0
Jul 01 21:31:24.316463 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:24.316163    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" event={"ID":"8b9846e5-71bf-4bb7-8c16-750102dcd26d","Type":"ContainerDied","Data":"5c50e156a964fbac52bc8c067e55bfcf9596260a35f93eb907c99a6eb6301eb3"}
Jul 01 21:31:24.316463 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:24.316216    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" event={"ID":"8b9846e5-71bf-4bb7-8c16-750102dcd26d","Type":"ContainerStarted","Data":"2861bc725c26d51538adfab458fb567b1cd3e737a7506f4a301fa87b470ea4fa"}
Jul 01 21:31:25.323572 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:25.323538    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" event={"ID":"8b9846e5-71bf-4bb7-8c16-750102dcd26d","Type":"ContainerStarted","Data":"24aea310037a7a5d7ae549f3c7aec9a0a8091b899cf6195cba6f348a0514f9f8"}
Jul 01 21:31:25.324018 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:25.323641    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:31:25.344546 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:25.344503    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" podStartSLOduration=2.603559015 podStartE2EDuration="3.344490722s" totalImagesPullingTime="0s" totalInitContainerRuntime="740.931707ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:31:25.341572983 +0000 UTC m=+2690.937459295" watchObservedRunningTime="2026-07-01 21:31:25.344490722 +0000 UTC m=+2690.940377034"
Jul 01 21:31:35.011927 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:35.011830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:31:35.125896 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:35.125870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:31:35.136668 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:35.136647    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:31:56.330590 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:31:56.330559    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:32:54.937159 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:32:54.937115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:08.671977 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:08.671896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:17.181792 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:17.181753    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:26.614939 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:26.614906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:26.763317 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:26.763279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:26.853098 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:26.853068    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:27.085483 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.085391    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"]
Jul 01 21:33:27.088964 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.088940    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.092153 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.092128    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa-dockercfg-7kdvp\""
Jul 01 21:33:27.093170 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.093142    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs\""
Jul 01 21:33:27.102053 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.102030    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"]
Jul 01 21:33:27.112767 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.112744    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-kserve-provision-location\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.112876 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.112776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-tokenizer-uds\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.112940 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.112900    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ed200c-e63c-4653-ad53-1a549716819c-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.113018 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.112940    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvmt7\" (UniqueName: \"kubernetes.io/projected/69ed200c-e63c-4653-ad53-1a549716819c-kube-api-access-rvmt7\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.128344 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.128310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:27.213383 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.213359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ed200c-e63c-4653-ad53-1a549716819c-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.213516 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.213392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvmt7\" (UniqueName: \"kubernetes.io/projected/69ed200c-e63c-4653-ad53-1a549716819c-kube-api-access-rvmt7\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.213516 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.213436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-kserve-provision-location\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.213516 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.213459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-tokenizer-uds\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.213888 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.213868    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-tokenizer-uds\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.213957 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.213889    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-kserve-provision-location\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.215942 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.215917    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ed200c-e63c-4653-ad53-1a549716819c-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.220689 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.220669    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvmt7\" (UniqueName: \"kubernetes.io/projected/69ed200c-e63c-4653-ad53-1a549716819c-kube-api-access-rvmt7\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") " pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.400168 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.400135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:27.543022 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.542979    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"]
Jul 01 21:33:27.544196 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:33:27.544171    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ed200c_e63c_4653_ad53_1a549716819c.slice/crio-b3317ae19b8a17245a2a230d1c2f93eb1ff0f5fa6933e58365286b25a36e44ac WatchSource:0}: Error finding container b3317ae19b8a17245a2a230d1c2f93eb1ff0f5fa6933e58365286b25a36e44ac: Status 404 returned error can't find the container with id b3317ae19b8a17245a2a230d1c2f93eb1ff0f5fa6933e58365286b25a36e44ac
Jul 01 21:33:27.997915 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.997885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" event={"ID":"69ed200c-e63c-4653-ad53-1a549716819c","Type":"ContainerStarted","Data":"8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4"}
Jul 01 21:33:27.998313 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:27.997961    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" event={"ID":"69ed200c-e63c-4653-ad53-1a549716819c","Type":"ContainerStarted","Data":"b3317ae19b8a17245a2a230d1c2f93eb1ff0f5fa6933e58365286b25a36e44ac"}
Jul 01 21:33:29.004009 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:29.003972    2569 generic.go:356] "Generic (PLEG): container finished" podID="69ed200c-e63c-4653-ad53-1a549716819c" containerID="8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4" exitCode=0
Jul 01 21:33:29.004397 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:29.004060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" event={"ID":"69ed200c-e63c-4653-ad53-1a549716819c","Type":"ContainerDied","Data":"8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4"}
Jul 01 21:33:30.011334 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:30.011301    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" event={"ID":"69ed200c-e63c-4653-ad53-1a549716819c","Type":"ContainerStarted","Data":"f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9"}
Jul 01 21:33:30.011711 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:30.011442    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:33:30.031064 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:30.031019    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" podStartSLOduration=2.371167411 podStartE2EDuration="3.03098783s" totalImagesPullingTime="0s" totalInitContainerRuntime="659.820419ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:33:30.029282853 +0000 UTC m=+2815.625169167" watchObservedRunningTime="2026-07-01 21:33:30.03098783 +0000 UTC m=+2815.626874140"
Jul 01 21:33:34.252264 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:34.252235    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:35.898842 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:35.898807    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"]
Jul 01 21:33:35.908027 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:33:35.907959    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:33:35.908027 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:33:35.908027 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:33:35.908027 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="24aea310037a7a5d7ae549f3c7aec9a0a8091b899cf6195cba6f348a0514f9f8" cmd=["/bin/sleep","15"]
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:35.908050    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" message="" err=<
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:33:35.908068    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerName="main" containerID="cri-o://24aea310037a7a5d7ae549f3c7aec9a0a8091b899cf6195cba6f348a0514f9f8"
Jul 01 21:33:35.908410 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:35.908122    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerName="main" containerID="cri-o://24aea310037a7a5d7ae549f3c7aec9a0a8091b899cf6195cba6f348a0514f9f8" gracePeriod=60
Jul 01 21:33:35.922310 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:35.922288    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:36.030272 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.030241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:33:36.051278 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.051248    2569 generic.go:356] "Generic (PLEG): container finished" podID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerID="24aea310037a7a5d7ae549f3c7aec9a0a8091b899cf6195cba6f348a0514f9f8" exitCode=0
Jul 01 21:33:36.051384 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.051287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" event={"ID":"8b9846e5-71bf-4bb7-8c16-750102dcd26d","Type":"ContainerDied","Data":"24aea310037a7a5d7ae549f3c7aec9a0a8091b899cf6195cba6f348a0514f9f8"}
Jul 01 21:33:36.171802 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.171777    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:33:36.291445 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.291422    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxtk6\" (UniqueName: \"kubernetes.io/projected/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kube-api-access-wxtk6\") pod \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") "
Jul 01 21:33:36.291594 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.291464    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tokenizer-uds\") pod \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") "
Jul 01 21:33:36.291594 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.291557    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tls-certs\") pod \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") "
Jul 01 21:33:36.291717 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.291595    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kserve-provision-location\") pod \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\" (UID: \"8b9846e5-71bf-4bb7-8c16-750102dcd26d\") "
Jul 01 21:33:36.291784 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.291763    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "8b9846e5-71bf-4bb7-8c16-750102dcd26d" (UID: "8b9846e5-71bf-4bb7-8c16-750102dcd26d"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:33:36.291876 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.291858    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:33:36.292260 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.292237    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8b9846e5-71bf-4bb7-8c16-750102dcd26d" (UID: "8b9846e5-71bf-4bb7-8c16-750102dcd26d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:33:36.293496 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.293477    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b9846e5-71bf-4bb7-8c16-750102dcd26d" (UID: "8b9846e5-71bf-4bb7-8c16-750102dcd26d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:33:36.293558 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.293516    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kube-api-access-wxtk6" (OuterVolumeSpecName: "kube-api-access-wxtk6") pod "8b9846e5-71bf-4bb7-8c16-750102dcd26d" (UID: "8b9846e5-71bf-4bb7-8c16-750102dcd26d"). InnerVolumeSpecName "kube-api-access-wxtk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:33:36.392601 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.392578    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxtk6\" (UniqueName: \"kubernetes.io/projected/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kube-api-access-wxtk6\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:33:36.392601 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.392598    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b9846e5-71bf-4bb7-8c16-750102dcd26d-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:33:36.392734 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:36.392609    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b9846e5-71bf-4bb7-8c16-750102dcd26d-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:33:37.058412 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:37.058386    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"
Jul 01 21:33:37.058769 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:37.058420    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq" event={"ID":"8b9846e5-71bf-4bb7-8c16-750102dcd26d","Type":"ContainerDied","Data":"2861bc725c26d51538adfab458fb567b1cd3e737a7506f4a301fa87b470ea4fa"}
Jul 01 21:33:37.058769 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:37.058477    2569 scope.go:117] "RemoveContainer" containerID="24aea310037a7a5d7ae549f3c7aec9a0a8091b899cf6195cba6f348a0514f9f8"
Jul 01 21:33:37.067574 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:37.067557    2569 scope.go:117] "RemoveContainer" containerID="5c50e156a964fbac52bc8c067e55bfcf9596260a35f93eb907c99a6eb6301eb3"
Jul 01 21:33:37.076208 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:37.076181    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"]
Jul 01 21:33:37.079234 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:37.079213    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq"]
Jul 01 21:33:38.966494 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:38.966452    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" path="/var/lib/kubelet/pods/8b9846e5-71bf-4bb7-8c16-750102dcd26d/volumes"
Jul 01 21:33:59.597079 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:33:59.597040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:34:01.019565 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:34:01.019536    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:36:35.167245 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:36:35.167215    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:36:35.180846 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:36:35.180825    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:38:04.510706 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:38:04.510633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:40:06.572798 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:40:06.572764    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:40:06.625446 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:40:06.625405    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:41:35.205881 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:41:35.205778    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:41:35.220259 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:41:35.220235    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:46:15.801778 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:15.801744    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:46:20.437328 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.437282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:46:20.452971 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.452941    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"]
Jul 01 21:46:20.464093 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:46:20.464050    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:46:20.464093 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:46:20.464093 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:46:20.464093 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9" cmd=["/bin/sleep","15"]
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.464105    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" message="" err=<
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:46:20.464119    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" podUID="69ed200c-e63c-4653-ad53-1a549716819c" containerName="main" containerID="cri-o://f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9"
Jul 01 21:46:20.464389 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.464158    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" podUID="69ed200c-e63c-4653-ad53-1a549716819c" containerName="main" containerID="cri-o://f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9" gracePeriod=60
Jul 01 21:46:20.505169 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.505145    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:46:20.721678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.721652    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:46:20.774860 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.774835    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvmt7\" (UniqueName: \"kubernetes.io/projected/69ed200c-e63c-4653-ad53-1a549716819c-kube-api-access-rvmt7\") pod \"69ed200c-e63c-4653-ad53-1a549716819c\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") "
Jul 01 21:46:20.775047 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.774890    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-kserve-provision-location\") pod \"69ed200c-e63c-4653-ad53-1a549716819c\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") "
Jul 01 21:46:20.775047 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.774968    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-tokenizer-uds\") pod \"69ed200c-e63c-4653-ad53-1a549716819c\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") "
Jul 01 21:46:20.775047 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.775042    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ed200c-e63c-4653-ad53-1a549716819c-tls-certs\") pod \"69ed200c-e63c-4653-ad53-1a549716819c\" (UID: \"69ed200c-e63c-4653-ad53-1a549716819c\") "
Jul 01 21:46:20.775280 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.775247    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "69ed200c-e63c-4653-ad53-1a549716819c" (UID: "69ed200c-e63c-4653-ad53-1a549716819c"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:46:20.775387 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.775361    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:46:20.775676 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.775655    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "69ed200c-e63c-4653-ad53-1a549716819c" (UID: "69ed200c-e63c-4653-ad53-1a549716819c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:46:20.776873 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.776853    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ed200c-e63c-4653-ad53-1a549716819c-kube-api-access-rvmt7" (OuterVolumeSpecName: "kube-api-access-rvmt7") pod "69ed200c-e63c-4653-ad53-1a549716819c" (UID: "69ed200c-e63c-4653-ad53-1a549716819c"). InnerVolumeSpecName "kube-api-access-rvmt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:46:20.776985 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.776965    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ed200c-e63c-4653-ad53-1a549716819c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69ed200c-e63c-4653-ad53-1a549716819c" (UID: "69ed200c-e63c-4653-ad53-1a549716819c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:46:20.876201 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.876182    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ed200c-e63c-4653-ad53-1a549716819c-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:46:20.876292 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.876203    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvmt7\" (UniqueName: \"kubernetes.io/projected/69ed200c-e63c-4653-ad53-1a549716819c-kube-api-access-rvmt7\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:46:20.876292 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:20.876214    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69ed200c-e63c-4653-ad53-1a549716819c-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:46:21.292678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.292597    2569 generic.go:356] "Generic (PLEG): container finished" podID="69ed200c-e63c-4653-ad53-1a549716819c" containerID="f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9" exitCode=0
Jul 01 21:46:21.292678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.292656    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"
Jul 01 21:46:21.292944 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.292682    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" event={"ID":"69ed200c-e63c-4653-ad53-1a549716819c","Type":"ContainerDied","Data":"f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9"}
Jul 01 21:46:21.292944 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.292735    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw" event={"ID":"69ed200c-e63c-4653-ad53-1a549716819c","Type":"ContainerDied","Data":"b3317ae19b8a17245a2a230d1c2f93eb1ff0f5fa6933e58365286b25a36e44ac"}
Jul 01 21:46:21.292944 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.292758    2569 scope.go:117] "RemoveContainer" containerID="f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9"
Jul 01 21:46:21.301925 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.301908    2569 scope.go:117] "RemoveContainer" containerID="8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4"
Jul 01 21:46:21.310423 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.310403    2569 scope.go:117] "RemoveContainer" containerID="f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9"
Jul 01 21:46:21.310742 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:46:21.310716    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9\": container with ID starting with f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9 not found: ID does not exist" containerID="f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9"
Jul 01 21:46:21.310843 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.310756    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9"} err="failed to get container status \"f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9\": rpc error: code = NotFound desc = could not find container \"f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9\": container with ID starting with f12d27f0c3f914882abea511ad62aca95ef18b41f03acd89dd100e9eaf3732b9 not found: ID does not exist"
Jul 01 21:46:21.310843 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.310774    2569 scope.go:117] "RemoveContainer" containerID="8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4"
Jul 01 21:46:21.311081 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:46:21.311058    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4\": container with ID starting with 8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4 not found: ID does not exist" containerID="8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4"
Jul 01 21:46:21.311132 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.311089    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4"} err="failed to get container status \"8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4\": rpc error: code = NotFound desc = could not find container \"8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4\": container with ID starting with 8783c90b810c1d49d11479cb4160e7112ce08334519ace974b5e9e66f3cda3e4 not found: ID does not exist"
Jul 01 21:46:21.312317 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.312299    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"]
Jul 01 21:46:21.318180 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:21.318161    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw"]
Jul 01 21:46:22.965892 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:22.965857    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69ed200c-e63c-4653-ad53-1a549716819c" path="/var/lib/kubelet/pods/69ed200c-e63c-4653-ad53-1a549716819c/volumes"
Jul 01 21:46:35.243894 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:35.243783    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:46:35.258949 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:35.258931    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:46:44.686792 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:46:44.686760    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:47:16.979472 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:47:16.979432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:47:19.373373 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:47:19.373337    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:47:19.661221 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:47:19.661138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:47:30.173541 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:47:30.173510    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:47:52.497214 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:47:52.497176    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:47:52.597179 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:47:52.597145    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:48:28.504341 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:48:28.504308    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:48:28.750358 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:48:28.750321    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:48:49.039556 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:48:49.039525    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:49:12.651163 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:49:12.651124    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:49:12.713120 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:49:12.713091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:51:35.278069 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:51:35.277948    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:51:35.294298 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:51:35.294279    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:54:39.365816 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:54:39.365777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:15.360778 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.360727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:15.701756 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.701654    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"]
Jul 01 21:55:15.702226 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702198    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ed200c-e63c-4653-ad53-1a549716819c" containerName="main"
Jul 01 21:55:15.702226 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702219    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ed200c-e63c-4653-ad53-1a549716819c" containerName="main"
Jul 01 21:55:15.702357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702237    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerName="main"
Jul 01 21:55:15.702357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702242    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerName="main"
Jul 01 21:55:15.702357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702257    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ed200c-e63c-4653-ad53-1a549716819c" containerName="storage-initializer"
Jul 01 21:55:15.702357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702265    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ed200c-e63c-4653-ad53-1a549716819c" containerName="storage-initializer"
Jul 01 21:55:15.702357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702284    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerName="storage-initializer"
Jul 01 21:55:15.702357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702290    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerName="storage-initializer"
Jul 01 21:55:15.702357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702356    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9846e5-71bf-4bb7-8c16-750102dcd26d" containerName="main"
Jul 01 21:55:15.702651 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.702369    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="69ed200c-e63c-4653-ad53-1a549716819c" containerName="main"
Jul 01 21:55:15.705534 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.705519    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.707904 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.707884    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:55:15.708054 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.707959    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"tls-verification-test-epp-sa-dockercfg-wrt9n\""
Jul 01 21:55:15.708718 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.708693    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"tls-verification-test-kserve-self-signed-certs\""
Jul 01 21:55:15.708824 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.708739    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 21:55:15.716813 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.716796    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"]
Jul 01 21:55:15.729302 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.729277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:15.802354 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.802331    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg954\" (UniqueName: \"kubernetes.io/projected/a547dfe5-d219-42f0-83c7-962bf9472b76-kube-api-access-vg954\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.802453 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.802369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a547dfe5-d219-42f0-83c7-962bf9472b76-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.802453 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.802394    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-tokenizer-uds\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.802528 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.802490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-kserve-provision-location\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.903398 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.903365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg954\" (UniqueName: \"kubernetes.io/projected/a547dfe5-d219-42f0-83c7-962bf9472b76-kube-api-access-vg954\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.903526 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.903412    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a547dfe5-d219-42f0-83c7-962bf9472b76-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.903526 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.903445    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-tokenizer-uds\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.903526 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.903499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-kserve-provision-location\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.903813 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.903794    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-tokenizer-uds\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.903873 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.903855    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-kserve-provision-location\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.905854 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.905826    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a547dfe5-d219-42f0-83c7-962bf9472b76-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:15.911138 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:15.911086    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg954\" (UniqueName: \"kubernetes.io/projected/a547dfe5-d219-42f0-83c7-962bf9472b76-kube-api-access-vg954\") pod \"tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") " pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:16.016327 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:16.016267    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:16.021972 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:16.021947    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:16.166754 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:16.166728    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"]
Jul 01 21:55:16.167915 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:55:16.167891    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda547dfe5_d219_42f0_83c7_962bf9472b76.slice/crio-91f5720122e5a2b7920170f158066df9f6efd55494875ccd3125f678c1b0a937 WatchSource:0}: Error finding container 91f5720122e5a2b7920170f158066df9f6efd55494875ccd3125f678c1b0a937: Status 404 returned error can't find the container with id 91f5720122e5a2b7920170f158066df9f6efd55494875ccd3125f678c1b0a937
Jul 01 21:55:17.177095 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:17.177015    2569 generic.go:356] "Generic (PLEG): container finished" podID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerID="6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c" exitCode=0
Jul 01 21:55:17.177450 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:17.177102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" event={"ID":"a547dfe5-d219-42f0-83c7-962bf9472b76","Type":"ContainerDied","Data":"6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c"}
Jul 01 21:55:17.177450 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:17.177166    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" event={"ID":"a547dfe5-d219-42f0-83c7-962bf9472b76","Type":"ContainerStarted","Data":"91f5720122e5a2b7920170f158066df9f6efd55494875ccd3125f678c1b0a937"}
Jul 01 21:55:18.184438 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:18.184398    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" event={"ID":"a547dfe5-d219-42f0-83c7-962bf9472b76","Type":"ContainerStarted","Data":"3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6"}
Jul 01 21:55:18.184801 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:18.184487    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:55:18.204020 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:18.203954    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" podStartSLOduration=2.525881833 podStartE2EDuration="3.203941834s" totalImagesPullingTime="0s" totalInitContainerRuntime="678.060001ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:55:18.201362693 +0000 UTC m=+4123.797249030" watchObservedRunningTime="2026-07-01 21:55:18.203941834 +0000 UTC m=+4123.799828146"
Jul 01 21:55:25.620357 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:25.620320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:31.199058 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:31.198948    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:41.577623 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:41.577588    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:41.726759 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:41.726676    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:43.587168 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:43.587131    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:43.650521 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:43.650459    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:55:49.191613 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:55:49.191582    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:56:04.852941 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:56:04.852910    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:56:05.149647 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:56:05.149552    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:56:20.129733 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:56:20.129698    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:56:35.313561 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:56:35.313465    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:56:35.331643 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:56:35.331624    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 21:57:19.876727 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:19.876695    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"]
Jul 01 21:57:19.878100 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:19.878056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:57:19.886452 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:57:19.886417    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 21:57:19.886452 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:57:19.886452 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:57:19.886452 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6" cmd=["/bin/sleep","15"]
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:19.886458    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" message="" err=<
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:57:19.886470    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerName="main" containerID="cri-o://3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6"
Jul 01 21:57:19.886675 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:19.886504    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerName="main" containerID="cri-o://3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6" gracePeriod=60
Jul 01 21:57:19.942968 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:19.942936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:57:20.146473 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.146449    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:57:20.200571 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.200543    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-tokenizer-uds\") pod \"a547dfe5-d219-42f0-83c7-962bf9472b76\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") "
Jul 01 21:57:20.200678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.200603    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a547dfe5-d219-42f0-83c7-962bf9472b76-tls-certs\") pod \"a547dfe5-d219-42f0-83c7-962bf9472b76\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") "
Jul 01 21:57:20.200678 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.200628    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-kserve-provision-location\") pod \"a547dfe5-d219-42f0-83c7-962bf9472b76\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") "
Jul 01 21:57:20.200755 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.200688    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg954\" (UniqueName: \"kubernetes.io/projected/a547dfe5-d219-42f0-83c7-962bf9472b76-kube-api-access-vg954\") pod \"a547dfe5-d219-42f0-83c7-962bf9472b76\" (UID: \"a547dfe5-d219-42f0-83c7-962bf9472b76\") "
Jul 01 21:57:20.200793 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.200768    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "a547dfe5-d219-42f0-83c7-962bf9472b76" (UID: "a547dfe5-d219-42f0-83c7-962bf9472b76"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:57:20.200956 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.200940    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:57:20.201360 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.201340    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a547dfe5-d219-42f0-83c7-962bf9472b76" (UID: "a547dfe5-d219-42f0-83c7-962bf9472b76"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 21:57:20.202557 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.202533    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a547dfe5-d219-42f0-83c7-962bf9472b76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a547dfe5-d219-42f0-83c7-962bf9472b76" (UID: "a547dfe5-d219-42f0-83c7-962bf9472b76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 21:57:20.202655 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.202612    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a547dfe5-d219-42f0-83c7-962bf9472b76-kube-api-access-vg954" (OuterVolumeSpecName: "kube-api-access-vg954") pod "a547dfe5-d219-42f0-83c7-962bf9472b76" (UID: "a547dfe5-d219-42f0-83c7-962bf9472b76"). InnerVolumeSpecName "kube-api-access-vg954". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 21:57:20.302236 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.302212    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a547dfe5-d219-42f0-83c7-962bf9472b76-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:57:20.302236 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.302234    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a547dfe5-d219-42f0-83c7-962bf9472b76-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:57:20.302374 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.302244    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg954\" (UniqueName: \"kubernetes.io/projected/a547dfe5-d219-42f0-83c7-962bf9472b76-kube-api-access-vg954\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 21:57:20.870815 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.870782    2569 generic.go:356] "Generic (PLEG): container finished" podID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerID="3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6" exitCode=0
Jul 01 21:57:20.871029 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.870842    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"
Jul 01 21:57:20.871029 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.870866    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" event={"ID":"a547dfe5-d219-42f0-83c7-962bf9472b76","Type":"ContainerDied","Data":"3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6"}
Jul 01 21:57:20.871029 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.870917    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x" event={"ID":"a547dfe5-d219-42f0-83c7-962bf9472b76","Type":"ContainerDied","Data":"91f5720122e5a2b7920170f158066df9f6efd55494875ccd3125f678c1b0a937"}
Jul 01 21:57:20.871029 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.870939    2569 scope.go:117] "RemoveContainer" containerID="3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6"
Jul 01 21:57:20.882543 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.882435    2569 scope.go:117] "RemoveContainer" containerID="6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c"
Jul 01 21:57:20.892767 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.892571    2569 scope.go:117] "RemoveContainer" containerID="3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6"
Jul 01 21:57:20.893725 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:57:20.892922    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6\": container with ID starting with 3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6 not found: ID does not exist" containerID="3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6"
Jul 01 21:57:20.893725 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.892962    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6"} err="failed to get container status \"3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6\": rpc error: code = NotFound desc = could not find container \"3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6\": container with ID starting with 3f53ca12223d25f9dad6460aa668c76480d945a6ab3e730e68ffba24a6895be6 not found: ID does not exist"
Jul 01 21:57:20.893725 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.892986    2569 scope.go:117] "RemoveContainer" containerID="6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c"
Jul 01 21:57:20.893725 ip-10-0-132-117 kubenswrapper[2569]: E0701 21:57:20.893609    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c\": container with ID starting with 6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c not found: ID does not exist" containerID="6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c"
Jul 01 21:57:20.893725 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.893644    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c"} err="failed to get container status \"6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c\": rpc error: code = NotFound desc = could not find container \"6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c\": container with ID starting with 6e7e0f02ebf94e91c7cdae19aedbde6383ccef89ecd6143a7d4015c33a155f9c not found: ID does not exist"
Jul 01 21:57:20.896701 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.896670    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"]
Jul 01 21:57:20.900485 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.900466    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x"]
Jul 01 21:57:20.964850 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:20.964826    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" path="/var/lib/kubelet/pods/a547dfe5-d219-42f0-83c7-962bf9472b76/volumes"
Jul 01 21:57:39.327754 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:39.327689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:57:45.725500 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.725447    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:57:45.928721 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.928684    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"]
Jul 01 21:57:45.929291 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.929269    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerName="main"
Jul 01 21:57:45.929373 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.929294    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerName="main"
Jul 01 21:57:45.929373 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.929315    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerName="storage-initializer"
Jul 01 21:57:45.929373 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.929325    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerName="storage-initializer"
Jul 01 21:57:45.929473 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.929427    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a547dfe5-d219-42f0-83c7-962bf9472b76" containerName="main"
Jul 01 21:57:45.933844 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.933828    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:45.936750 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.936733    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 21:57:45.936865 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.936848    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"prestop-hook-test-kserve-self-signed-certs\""
Jul 01 21:57:45.937680 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.937664    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 21:57:45.937731 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.937668    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"prestop-hook-test-epp-sa-dockercfg-x5qn4\""
Jul 01 21:57:45.941509 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.941487    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"]
Jul 01 21:57:45.960505 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.960482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:57:45.999447 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.999395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tokenizer-uds\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:45.999447 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.999430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:45.999569 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.999451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5sb\" (UniqueName: \"kubernetes.io/projected/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kube-api-access-9k5sb\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:45.999569 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:45.999510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kserve-provision-location\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.100806 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.100774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tokenizer-uds\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.100977 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.100817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.100977 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.100835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5sb\" (UniqueName: \"kubernetes.io/projected/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kube-api-access-9k5sb\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.100977 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.100864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kserve-provision-location\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.101248 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.101231    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kserve-provision-location\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.101319 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.101300    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tokenizer-uds\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.103324 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.103293    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.109102 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.109083    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5sb\" (UniqueName: \"kubernetes.io/projected/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kube-api-access-9k5sb\") pod \"prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.244748 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.244722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:46.398158 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:46.398134    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"]
Jul 01 21:57:46.399417 ip-10-0-132-117 kubenswrapper[2569]: W0701 21:57:46.399391    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285e9b7e_2ef8_405b_a4aa_a2737692ad1b.slice/crio-6d738ee0650931e544b58680d93912e160f9ba39aa7dd6f3bddab0b4c75b1088 WatchSource:0}: Error finding container 6d738ee0650931e544b58680d93912e160f9ba39aa7dd6f3bddab0b4c75b1088: Status 404 returned error can't find the container with id 6d738ee0650931e544b58680d93912e160f9ba39aa7dd6f3bddab0b4c75b1088
Jul 01 21:57:47.033522 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:47.033490    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" event={"ID":"285e9b7e-2ef8-405b-a4aa-a2737692ad1b","Type":"ContainerStarted","Data":"c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e"}
Jul 01 21:57:47.033907 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:47.033538    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" event={"ID":"285e9b7e-2ef8-405b-a4aa-a2737692ad1b","Type":"ContainerStarted","Data":"6d738ee0650931e544b58680d93912e160f9ba39aa7dd6f3bddab0b4c75b1088"}
Jul 01 21:57:48.042545 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:48.042497    2569 generic.go:356] "Generic (PLEG): container finished" podID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerID="c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e" exitCode=0
Jul 01 21:57:48.043019 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:48.042622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" event={"ID":"285e9b7e-2ef8-405b-a4aa-a2737692ad1b","Type":"ContainerDied","Data":"c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e"}
Jul 01 21:57:49.056683 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:49.056631    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" event={"ID":"285e9b7e-2ef8-405b-a4aa-a2737692ad1b","Type":"ContainerStarted","Data":"6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086"}
Jul 01 21:57:49.057073 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:49.056805    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 21:57:49.075516 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:49.075471    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" podStartSLOduration=3.41789763 podStartE2EDuration="4.075458867s" totalImagesPullingTime="0s" totalInitContainerRuntime="657.561237ms" isStatefulPod=false podCreationTimestamp="2026-07-01 21:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:57:49.074544352 +0000 UTC m=+4274.670430666" watchObservedRunningTime="2026-07-01 21:57:49.075458867 +0000 UTC m=+4274.671345181"
Jul 01 21:57:50.336277 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:50.336245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:57:54.402659 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:57:54.402630    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 21:58:20.064208 ip-10-0-132-117 kubenswrapper[2569]: I0701 21:58:20.064175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 22:00:23.503306 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.503268    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"]
Jul 01 22:00:23.513862 ip-10-0-132-117 kubenswrapper[2569]: E0701 22:00:23.513821    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 22:00:23.513862 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 22:00:23.513862 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 22:00:23.513862 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086" cmd=["/bin/sleep","15"]
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.513882    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" message="" err=<
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]: E0701 22:00:23.513900    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerName="main" containerID="cri-o://6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086"
Jul 01 22:00:23.514238 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.513949    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerName="main" containerID="cri-o://6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086" gracePeriod=60
Jul 01 22:00:23.539527 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.539482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:00:23.761590 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.761534    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 22:00:23.869697 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.869668    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k5sb\" (UniqueName: \"kubernetes.io/projected/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kube-api-access-9k5sb\") pod \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") "
Jul 01 22:00:23.870184 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.870150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tokenizer-uds\") pod \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") "
Jul 01 22:00:23.870344 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.870265    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kserve-provision-location\") pod \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") "
Jul 01 22:00:23.870344 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.870317    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tls-certs\") pod \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\" (UID: \"285e9b7e-2ef8-405b-a4aa-a2737692ad1b\") "
Jul 01 22:00:23.870835 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.870782    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "285e9b7e-2ef8-405b-a4aa-a2737692ad1b" (UID: "285e9b7e-2ef8-405b-a4aa-a2737692ad1b"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 22:00:23.872839 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.870972    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:00:23.872839 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.871351    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "285e9b7e-2ef8-405b-a4aa-a2737692ad1b" (UID: "285e9b7e-2ef8-405b-a4aa-a2737692ad1b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 22:00:23.873035 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.872838    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kube-api-access-9k5sb" (OuterVolumeSpecName: "kube-api-access-9k5sb") pod "285e9b7e-2ef8-405b-a4aa-a2737692ad1b" (UID: "285e9b7e-2ef8-405b-a4aa-a2737692ad1b"). InnerVolumeSpecName "kube-api-access-9k5sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 22:00:23.873035 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.872916    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "285e9b7e-2ef8-405b-a4aa-a2737692ad1b" (UID: "285e9b7e-2ef8-405b-a4aa-a2737692ad1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 22:00:23.920152 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.920123    2569 generic.go:356] "Generic (PLEG): container finished" podID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerID="6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086" exitCode=0
Jul 01 22:00:23.920278 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.920186    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"
Jul 01 22:00:23.920278 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.920204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" event={"ID":"285e9b7e-2ef8-405b-a4aa-a2737692ad1b","Type":"ContainerDied","Data":"6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086"}
Jul 01 22:00:23.920388 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.920284    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db" event={"ID":"285e9b7e-2ef8-405b-a4aa-a2737692ad1b","Type":"ContainerDied","Data":"6d738ee0650931e544b58680d93912e160f9ba39aa7dd6f3bddab0b4c75b1088"}
Jul 01 22:00:23.920388 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.920311    2569 scope.go:117] "RemoveContainer" containerID="6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086"
Jul 01 22:00:23.931011 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.930971    2569 scope.go:117] "RemoveContainer" containerID="c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e"
Jul 01 22:00:23.938809 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.938790    2569 scope.go:117] "RemoveContainer" containerID="6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086"
Jul 01 22:00:23.939059 ip-10-0-132-117 kubenswrapper[2569]: E0701 22:00:23.939040    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086\": container with ID starting with 6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086 not found: ID does not exist" containerID="6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086"
Jul 01 22:00:23.939110 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.939068    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086"} err="failed to get container status \"6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086\": rpc error: code = NotFound desc = could not find container \"6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086\": container with ID starting with 6875ef7219e3c2286a90c64e5af82eda8ca7b73146926a9af34e71e2c8fb4086 not found: ID does not exist"
Jul 01 22:00:23.939110 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.939085    2569 scope.go:117] "RemoveContainer" containerID="c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e"
Jul 01 22:00:23.939305 ip-10-0-132-117 kubenswrapper[2569]: E0701 22:00:23.939289    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e\": container with ID starting with c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e not found: ID does not exist" containerID="c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e"
Jul 01 22:00:23.939365 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.939310    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e"} err="failed to get container status \"c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e\": rpc error: code = NotFound desc = could not find container \"c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e\": container with ID starting with c1d3336a639eae67d7fcf4474e1bb867eebe7ca7b6a0333120c3c1b5d8edb35e not found: ID does not exist"
Jul 01 22:00:23.943184 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.943163    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"]
Jul 01 22:00:23.948478 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.948456    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db"]
Jul 01 22:00:23.971678 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.971656    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kserve-provision-location\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:00:23.971678 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.971676    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:00:23.971777 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:23.971687    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k5sb\" (UniqueName: \"kubernetes.io/projected/285e9b7e-2ef8-405b-a4aa-a2737692ad1b-kube-api-access-9k5sb\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:00:24.964121 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:24.964090    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" path="/var/lib/kubelet/pods/285e9b7e-2ef8-405b-a4aa-a2737692ad1b/volumes"
Jul 01 22:00:25.523071 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:25.523035    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:00:51.603976 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.603938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:00:51.993094 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.993020    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"]
Jul 01 22:00:51.993429 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.993406    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerName="storage-initializer"
Jul 01 22:00:51.993429 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.993421    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerName="storage-initializer"
Jul 01 22:00:51.993585 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.993437    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerName="main"
Jul 01 22:00:51.993585 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.993443    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerName="main"
Jul 01 22:00:51.993585 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.993499    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="285e9b7e-2ef8-405b-a4aa-a2737692ad1b" containerName="main"
Jul 01 22:00:51.997875 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:51.997855    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.001558 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.001513    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-epp-sa-dockercfg-6zdwb\""
Jul 01 22:00:52.001702 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.001513    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 22:00:52.001702 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.001582    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Jul 01 22:00:52.004288 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.004262    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"]
Jul 01 22:00:52.019607 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.019575    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:00:52.088291 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.088262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/219ade09-264d-4908-bb9e-7db84f1b2e85-tokenizer-uds\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.088429 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.088295    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219ade09-264d-4908-bb9e-7db84f1b2e85-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.088429 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.088333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpm46\" (UniqueName: \"kubernetes.io/projected/219ade09-264d-4908-bb9e-7db84f1b2e85-kube-api-access-fpm46\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.189350 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.189321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/219ade09-264d-4908-bb9e-7db84f1b2e85-tokenizer-uds\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.189350 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.189352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219ade09-264d-4908-bb9e-7db84f1b2e85-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.189578 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.189384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpm46\" (UniqueName: \"kubernetes.io/projected/219ade09-264d-4908-bb9e-7db84f1b2e85-kube-api-access-fpm46\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.189710 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.189688    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/219ade09-264d-4908-bb9e-7db84f1b2e85-tokenizer-uds\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.191851 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.191828    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219ade09-264d-4908-bb9e-7db84f1b2e85-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.197424 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.197402    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpm46\" (UniqueName: \"kubernetes.io/projected/219ade09-264d-4908-bb9e-7db84f1b2e85-kube-api-access-fpm46\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.258103 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.258021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:00:52.308513 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.308489    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:52.441709 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:52.441680    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"]
Jul 01 22:00:52.443264 ip-10-0-132-117 kubenswrapper[2569]: W0701 22:00:52.443239    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219ade09_264d_4908_bb9e_7db84f1b2e85.slice/crio-143b36287379cf3da5aaca20bf9cd5618c5e89a978db3219270938a2036feec6 WatchSource:0}: Error finding container 143b36287379cf3da5aaca20bf9cd5618c5e89a978db3219270938a2036feec6: Status 404 returned error can't find the container with id 143b36287379cf3da5aaca20bf9cd5618c5e89a978db3219270938a2036feec6
Jul 01 22:00:53.073756 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:53.073705    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" event={"ID":"219ade09-264d-4908-bb9e-7db84f1b2e85","Type":"ContainerStarted","Data":"d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f"}
Jul 01 22:00:53.074203 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:53.073799    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" event={"ID":"219ade09-264d-4908-bb9e-7db84f1b2e85","Type":"ContainerStarted","Data":"143b36287379cf3da5aaca20bf9cd5618c5e89a978db3219270938a2036feec6"}
Jul 01 22:00:53.074203 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:53.073908    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:00:53.090733 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:00:53.090690    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" podStartSLOduration=2.090664549 podStartE2EDuration="2.090664549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:00:53.08944462 +0000 UTC m=+4458.685330927" watchObservedRunningTime="2026-07-01 22:00:53.090664549 +0000 UTC m=+4458.686550862"
Jul 01 22:01:07.188725 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:07.188687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:01:08.796685 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:08.796621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:01:08.858396 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:08.858366    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:01:24.080559 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:24.080529    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:01:35.358581 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:35.358558    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:01:35.370142 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:35.370122    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:01:49.886713 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:49.886669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:01:50.351507 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:50.351475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:01:52.483138 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.483099    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"]
Jul 01 22:01:52.490182 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.490156    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:01:52.492743 ip-10-0-132-117 kubenswrapper[2569]: E0701 22:01:52.492712    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 01 22:01:52.492743 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 22:01:52.492743 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 22:01:52.492743 ip-10-0-132-117 kubenswrapper[2569]:  > containerID="d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f" cmd=["/bin/sleep","15"]
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.492756    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" message="" err=<
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]:  >
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]: E0701 22:01:52.492769    2569 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" podUID="219ade09-264d-4908-bb9e-7db84f1b2e85" containerName="main" containerID="cri-o://d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f"
Jul 01 22:01:52.492975 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.492804    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" podUID="219ade09-264d-4908-bb9e-7db84f1b2e85" containerName="main" containerID="cri-o://d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f" gracePeriod=60
Jul 01 22:01:52.589333 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.589307    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:01:52.747732 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.747680    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:01:52.785421 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.785394    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219ade09-264d-4908-bb9e-7db84f1b2e85-tls-certs\") pod \"219ade09-264d-4908-bb9e-7db84f1b2e85\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") "
Jul 01 22:01:52.785553 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.785452    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/219ade09-264d-4908-bb9e-7db84f1b2e85-tokenizer-uds\") pod \"219ade09-264d-4908-bb9e-7db84f1b2e85\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") "
Jul 01 22:01:52.785553 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.785519    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpm46\" (UniqueName: \"kubernetes.io/projected/219ade09-264d-4908-bb9e-7db84f1b2e85-kube-api-access-fpm46\") pod \"219ade09-264d-4908-bb9e-7db84f1b2e85\" (UID: \"219ade09-264d-4908-bb9e-7db84f1b2e85\") "
Jul 01 22:01:52.785774 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.785751    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219ade09-264d-4908-bb9e-7db84f1b2e85-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "219ade09-264d-4908-bb9e-7db84f1b2e85" (UID: "219ade09-264d-4908-bb9e-7db84f1b2e85"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 22:01:52.787449 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.787419    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/219ade09-264d-4908-bb9e-7db84f1b2e85-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "219ade09-264d-4908-bb9e-7db84f1b2e85" (UID: "219ade09-264d-4908-bb9e-7db84f1b2e85"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 22:01:52.787544 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.787520    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/219ade09-264d-4908-bb9e-7db84f1b2e85-kube-api-access-fpm46" (OuterVolumeSpecName: "kube-api-access-fpm46") pod "219ade09-264d-4908-bb9e-7db84f1b2e85" (UID: "219ade09-264d-4908-bb9e-7db84f1b2e85"). InnerVolumeSpecName "kube-api-access-fpm46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 22:01:52.886760 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.886734    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpm46\" (UniqueName: \"kubernetes.io/projected/219ade09-264d-4908-bb9e-7db84f1b2e85-kube-api-access-fpm46\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:01:52.886760 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.886756    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/219ade09-264d-4908-bb9e-7db84f1b2e85-tls-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:01:52.886888 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:52.886765    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/219ade09-264d-4908-bb9e-7db84f1b2e85-tokenizer-uds\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:01:53.398303 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.398270    2569 generic.go:356] "Generic (PLEG): container finished" podID="219ade09-264d-4908-bb9e-7db84f1b2e85" containerID="d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f" exitCode=0
Jul 01 22:01:53.398475 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.398324    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"
Jul 01 22:01:53.398475 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.398358    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" event={"ID":"219ade09-264d-4908-bb9e-7db84f1b2e85","Type":"ContainerDied","Data":"d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f"}
Jul 01 22:01:53.398475 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.398409    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr" event={"ID":"219ade09-264d-4908-bb9e-7db84f1b2e85","Type":"ContainerDied","Data":"143b36287379cf3da5aaca20bf9cd5618c5e89a978db3219270938a2036feec6"}
Jul 01 22:01:53.398475 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.398430    2569 scope.go:117] "RemoveContainer" containerID="d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f"
Jul 01 22:01:53.407388 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.407372    2569 scope.go:117] "RemoveContainer" containerID="d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f"
Jul 01 22:01:53.407652 ip-10-0-132-117 kubenswrapper[2569]: E0701 22:01:53.407630    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f\": container with ID starting with d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f not found: ID does not exist" containerID="d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f"
Jul 01 22:01:53.407723 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.407665    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f"} err="failed to get container status \"d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f\": rpc error: code = NotFound desc = could not find container \"d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f\": container with ID starting with d1d2a50109a55b44bbc8cad3d886999d4915e45bd0ce45e35cf29126a6c7426f not found: ID does not exist"
Jul 01 22:01:53.414725 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.414705    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"]
Jul 01 22:01:53.418193 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:53.418171    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr"]
Jul 01 22:01:54.965768 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:01:54.965727    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="219ade09-264d-4908-bb9e-7db84f1b2e85" path="/var/lib/kubelet/pods/219ade09-264d-4908-bb9e-7db84f1b2e85/volumes"
Jul 01 22:02:07.069811 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:07.069752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:02:15.677168 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.677131    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"]
Jul 01 22:02:15.677544 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.677498    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="219ade09-264d-4908-bb9e-7db84f1b2e85" containerName="main"
Jul 01 22:02:15.677544 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.677509    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="219ade09-264d-4908-bb9e-7db84f1b2e85" containerName="main"
Jul 01 22:02:15.677619 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.677583    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="219ade09-264d-4908-bb9e-7db84f1b2e85" containerName="main"
Jul 01 22:02:15.680868 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.680848    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:15.688229 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.688207    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"]
Jul 01 22:02:15.768092 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.768055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kbc7\" (UniqueName: \"kubernetes.io/projected/45537f75-4552-4509-a31c-2bb8fdfc6709-kube-api-access-7kbc7\") pod \"llmisvc-controller-manager-598d4f65c9-qj6wh\" (UID: \"45537f75-4552-4509-a31c-2bb8fdfc6709\") " pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:15.768242 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.768109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45537f75-4552-4509-a31c-2bb8fdfc6709-cert\") pod \"llmisvc-controller-manager-598d4f65c9-qj6wh\" (UID: \"45537f75-4552-4509-a31c-2bb8fdfc6709\") " pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:15.868754 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.868723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kbc7\" (UniqueName: \"kubernetes.io/projected/45537f75-4552-4509-a31c-2bb8fdfc6709-kube-api-access-7kbc7\") pod \"llmisvc-controller-manager-598d4f65c9-qj6wh\" (UID: \"45537f75-4552-4509-a31c-2bb8fdfc6709\") " pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:15.868912 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.868778    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45537f75-4552-4509-a31c-2bb8fdfc6709-cert\") pod \"llmisvc-controller-manager-598d4f65c9-qj6wh\" (UID: \"45537f75-4552-4509-a31c-2bb8fdfc6709\") " pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:15.871261 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.871239    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45537f75-4552-4509-a31c-2bb8fdfc6709-cert\") pod \"llmisvc-controller-manager-598d4f65c9-qj6wh\" (UID: \"45537f75-4552-4509-a31c-2bb8fdfc6709\") " pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:15.876372 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.876346    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kbc7\" (UniqueName: \"kubernetes.io/projected/45537f75-4552-4509-a31c-2bb8fdfc6709-kube-api-access-7kbc7\") pod \"llmisvc-controller-manager-598d4f65c9-qj6wh\" (UID: \"45537f75-4552-4509-a31c-2bb8fdfc6709\") " pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:15.990780 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:15.990687    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:16.118820 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:16.118795    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"]
Jul 01 22:02:16.120516 ip-10-0-132-117 kubenswrapper[2569]: W0701 22:02:16.120480    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod45537f75_4552_4509_a31c_2bb8fdfc6709.slice/crio-67886b1bd1b735edbc4ed0e3e70808651ae67280576dd497cec1b2cbf80b438d WatchSource:0}: Error finding container 67886b1bd1b735edbc4ed0e3e70808651ae67280576dd497cec1b2cbf80b438d: Status 404 returned error can't find the container with id 67886b1bd1b735edbc4ed0e3e70808651ae67280576dd497cec1b2cbf80b438d
Jul 01 22:02:16.122062 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:16.122045    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 22:02:16.528628 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:16.528590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh" event={"ID":"45537f75-4552-4509-a31c-2bb8fdfc6709","Type":"ContainerStarted","Data":"67886b1bd1b735edbc4ed0e3e70808651ae67280576dd497cec1b2cbf80b438d"}
Jul 01 22:02:17.534922 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:17.534892    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh" event={"ID":"45537f75-4552-4509-a31c-2bb8fdfc6709","Type":"ContainerStarted","Data":"ca214bdc88119f0d3500f5458bcfe8852ec52162f26094cbac816fabfce27b95"}
Jul 01 22:02:17.535379 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:17.535026    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:17.551227 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:17.551180    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh" podStartSLOduration=2.044569408 podStartE2EDuration="2.551166333s" totalImagesPullingTime="506.596925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:02:17.550016012 +0000 UTC m=+4543.145902322" watchObservedRunningTime="2026-07-01 22:02:17.551166333 +0000 UTC m=+4543.147052646"
Jul 01 22:02:48.543280 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:48.543235    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-598d4f65c9-qj6wh"
Jul 01 22:02:48.586641 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:48.586610    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"]
Jul 01 22:02:48.586861 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:48.586836    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4" podUID="fb0372ae-f06b-41ac-957b-94d4758a4075" containerName="manager" containerID="cri-o://d6f7a2c3a18dfc9a435abf17d165ef26ba549ec84b0959c34d440aef768487f1" gracePeriod=30
Jul 01 22:02:48.712396 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:48.712364    2569 generic.go:356] "Generic (PLEG): container finished" podID="fb0372ae-f06b-41ac-957b-94d4758a4075" containerID="d6f7a2c3a18dfc9a435abf17d165ef26ba549ec84b0959c34d440aef768487f1" exitCode=0
Jul 01 22:02:48.712516 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:48.712417    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4" event={"ID":"fb0372ae-f06b-41ac-957b-94d4758a4075","Type":"ContainerDied","Data":"d6f7a2c3a18dfc9a435abf17d165ef26ba549ec84b0959c34d440aef768487f1"}
Jul 01 22:02:48.843837 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:48.843814    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 22:02:49.032097 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.032068    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g57l\" (UniqueName: \"kubernetes.io/projected/fb0372ae-f06b-41ac-957b-94d4758a4075-kube-api-access-8g57l\") pod \"fb0372ae-f06b-41ac-957b-94d4758a4075\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") "
Jul 01 22:02:49.032244 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.032162    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb0372ae-f06b-41ac-957b-94d4758a4075-cert\") pod \"fb0372ae-f06b-41ac-957b-94d4758a4075\" (UID: \"fb0372ae-f06b-41ac-957b-94d4758a4075\") "
Jul 01 22:02:49.034139 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.034113    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb0372ae-f06b-41ac-957b-94d4758a4075-cert" (OuterVolumeSpecName: "cert") pod "fb0372ae-f06b-41ac-957b-94d4758a4075" (UID: "fb0372ae-f06b-41ac-957b-94d4758a4075"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 22:02:49.034260 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.034155    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb0372ae-f06b-41ac-957b-94d4758a4075-kube-api-access-8g57l" (OuterVolumeSpecName: "kube-api-access-8g57l") pod "fb0372ae-f06b-41ac-957b-94d4758a4075" (UID: "fb0372ae-f06b-41ac-957b-94d4758a4075"). InnerVolumeSpecName "kube-api-access-8g57l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 22:02:49.133688 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.133662    2569 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb0372ae-f06b-41ac-957b-94d4758a4075-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:02:49.133688 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.133688    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g57l\" (UniqueName: \"kubernetes.io/projected/fb0372ae-f06b-41ac-957b-94d4758a4075-kube-api-access-8g57l\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\""
Jul 01 22:02:49.719325 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.719298    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"
Jul 01 22:02:49.719730 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.719339    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4" event={"ID":"fb0372ae-f06b-41ac-957b-94d4758a4075","Type":"ContainerDied","Data":"215bbd8e7b46458139a114a771b4c6c7af344225f4c3b36092aa268adef9e01f"}
Jul 01 22:02:49.719730 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.719413    2569 scope.go:117] "RemoveContainer" containerID="d6f7a2c3a18dfc9a435abf17d165ef26ba549ec84b0959c34d440aef768487f1"
Jul 01 22:02:49.741404 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.741371    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"]
Jul 01 22:02:49.744401 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:49.744375    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/llmisvc-controller-manager-69fcb569d9-h8mg4"]
Jul 01 22:02:50.965658 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:50.965616    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb0372ae-f06b-41ac-957b-94d4758a4075" path="/var/lib/kubelet/pods/fb0372ae-f06b-41ac-957b-94d4758a4075/volumes"
Jul 01 22:02:53.765871 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:02:53.765831    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve/llmisvc-controller-manager-69fcb569d9-h8mg4" podUID="fb0372ae-f06b-41ac-957b-94d4758a4075" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.26:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 01 22:03:26.241707 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.241670    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"]
Jul 01 22:03:26.242217 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.242077    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb0372ae-f06b-41ac-957b-94d4758a4075" containerName="manager"
Jul 01 22:03:26.242217 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.242091    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb0372ae-f06b-41ac-957b-94d4758a4075" containerName="manager"
Jul 01 22:03:26.242217 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.242164    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb0372ae-f06b-41ac-957b-94d4758a4075" containerName="manager"
Jul 01 22:03:26.245153 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.245135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.249363 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.249344    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 01 22:03:26.249972 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.249956    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-dockercfg-srv9x\""
Jul 01 22:03:26.250199 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.250187    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-76tz7\""
Jul 01 22:03:26.270502 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.270480    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"]
Jul 01 22:03:26.309129 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.309101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:03:26.317288 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.317266    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czsgj\" (UniqueName: \"kubernetes.io/projected/70d7b504-f4b5-4838-8df9-c3629355aa72-kube-api-access-czsgj\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.317375 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.317301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-home\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.317375 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.317318    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.317456 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.317379    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.317456 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.317396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d7b504-f4b5-4838-8df9-c3629355aa72-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.317456 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.317416    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418337 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418337 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418339    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d7b504-f4b5-4838-8df9-c3629355aa72-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418515 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418366    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418515 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czsgj\" (UniqueName: \"kubernetes.io/projected/70d7b504-f4b5-4838-8df9-c3629355aa72-kube-api-access-czsgj\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418515 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-home\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418673 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418792 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418763    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418915 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418797    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.418915 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.418872    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-home\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.420691 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.420666    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d7b504-f4b5-4838-8df9-c3629355aa72-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.421119 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.421098    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d7b504-f4b5-4838-8df9-c3629355aa72-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.427394 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.427373    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czsgj\" (UniqueName: \"kubernetes.io/projected/70d7b504-f4b5-4838-8df9-c3629355aa72-kube-api-access-czsgj\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz\" (UID: \"70d7b504-f4b5-4838-8df9-c3629355aa72\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.555201 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.555145    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:26.660935 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.660905    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:03:26.697738 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.697711    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"]
Jul 01 22:03:26.699013 ip-10-0-132-117 kubenswrapper[2569]: W0701 22:03:26.698966    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d7b504_f4b5_4838_8df9_c3629355aa72.slice/crio-fe02f81ca731a245c5536cdd6dae9da0bf24772c789ea4f0457049a050e9754e WatchSource:0}: Error finding container fe02f81ca731a245c5536cdd6dae9da0bf24772c789ea4f0457049a050e9754e: Status 404 returned error can't find the container with id fe02f81ca731a245c5536cdd6dae9da0bf24772c789ea4f0457049a050e9754e
Jul 01 22:03:26.937292 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:26.937248    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz" event={"ID":"70d7b504-f4b5-4838-8df9-c3629355aa72","Type":"ContainerStarted","Data":"fe02f81ca731a245c5536cdd6dae9da0bf24772c789ea4f0457049a050e9754e"}
Jul 01 22:03:27.943901 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:27.943868    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz" event={"ID":"70d7b504-f4b5-4838-8df9-c3629355aa72","Type":"ContainerStarted","Data":"cba610fa38e690fecb0ab799e0eb2e77a105ef84a0e05f86340a190db1ececc1"}
Jul 01 22:03:27.944294 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:27.943934    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:28.951070 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:28.951031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz" event={"ID":"70d7b504-f4b5-4838-8df9-c3629355aa72","Type":"ContainerStarted","Data":"70e6b3d82670e8c0f0d049bad6cc8c6b2f0ca01ea609c5499a00df7cba72e511"}
Jul 01 22:03:28.970910 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:28.970848    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz" podStartSLOduration=2.230830924 podStartE2EDuration="2.970828963s" totalImagesPullingTime="739.998039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:03:28.967110711 +0000 UTC m=+4614.562997023" watchObservedRunningTime="2026-07-01 22:03:28.970828963 +0000 UTC m=+4614.566715277"
Jul 01 22:03:29.556158 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:29.556126    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:29.691504 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:29.691474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:03:29.791725 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:29.791683    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:03:35.067447 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:35.067418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:03:36.556064 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:36.556037    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:36.568205 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:36.568183    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:37.004463 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:37.004438    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:38.011202 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:38.011178    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz"
Jul 01 22:03:46.374150 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:03:46.374114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:04:03.264332 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:04:03.264298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:04:03.450808 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:04:03.450772    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:04:14.881194 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:04:14.881157    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:04:19.687269 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:04:19.687229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:04:36.412076 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:04:36.409893    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:04:36.508064 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:04:36.508025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:04:59.030712 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:04:59.030680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:06:35.398292 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:06:35.398191    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:06:35.409363 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:06:35.409341    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:08:23.661685 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:08:23.661653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:10:43.418819 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:10:43.418730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:11:35.441056 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:11:35.440912    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:11:35.449909 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:11:35.449887    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:13:56.249262 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:13:56.249170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:13:57.549585 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:13:57.549542    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:14:17.025957 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:14:17.025920    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"]
Jul 01 22:14:17.030799 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:14:17.030776    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/e2e-pvc-model-download-9dx26"]
Jul 01 22:14:18.964988 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:14:18.964954    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd3b08b-9cdb-4268-a66e-145e8b644134" path="/var/lib/kubelet/pods/2fd3b08b-9cdb-4268-a66e-145e8b644134/volumes"
Jul 01 22:14:35.632013 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:14:35.631962    2569 scope.go:117] "RemoveContainer" containerID="5a0d299f8ba4ab8684656509671ef64e7dbc023c01e7c33dc2fce1ca6b8c756d"
Jul 01 22:15:18.787325 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:15:18.787292    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:16:35.482515 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:16:35.482409    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:16:35.492050 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:16:35.492030    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:17:11.998520 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:17:11.998484    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:20:41.531560 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:20:41.531528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:21:35.519261 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:21:35.519161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:21:35.529539 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:21:35.529519    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:22:37.310858 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:22:37.310774    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:23:33.521760 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:23:33.521727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:25:23.807840 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:25:23.807809    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:25:23.818527 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:25:23.818505    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:25:44.448349 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:25:44.448264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:25:45.623044 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:25:45.622980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:26:03.852956 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:26:03.852919    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:26:35.563698 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:26:35.563572    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:26:35.574519 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:26:35.574501    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:30:25.513482 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:30:25.513440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:30:25.607204 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:30:25.607172    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:31:35.600112 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:31:35.600077    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:31:35.611465 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:31:35.611438    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2zrq_e3f536c1-9066-494e-be39-2a69df7f8e3d/ovn-acl-logging/0.log"
Jul 01 22:32:09.222426 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:09.222383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:32:18.582603 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:18.582568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:32:18.653832 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:18.653799    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:32:39.713606 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:39.713576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:32:39.805478 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:39.805446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:32:55.525417 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:55.525371    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:32:55.526047 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:55.525625    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:32:55.538862 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:55.538835    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:32:55.538862 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:55.538860    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:32:55.554903 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:55.554875    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:32:55.587254 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:55.587234    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:32:57.096296 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:57.096226    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:32:57.096683 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:57.096666    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:32:57.123198 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:57.123176    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:32:57.123198 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:57.123196    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:32:57.146248 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:57.146230    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:32:57.168876 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:57.168856    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:32:58.683151 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:58.683121    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:32:58.683606 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:58.683591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:32:58.696764 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:58.696743    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:32:58.696889 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:58.696875    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:32:58.709140 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:58.709123    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:32:58.724377 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:32:58.724356    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:00.197839 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:00.197810    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:00.198369 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:00.198099    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:00.213339 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:00.213317    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:00.213483 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:00.213350    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:00.227044 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:00.227025    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:00.241633 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:00.241574    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:01.705722 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:01.705654    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:01.706362 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:01.706041    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:01.718683 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:01.718662    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:01.718883 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:01.718866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:01.731089 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:01.731069    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:01.747816 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:01.747796    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:03.271522 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:03.271493    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:03.271894 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:03.271862    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:03.284672 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:03.284652    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:03.284672 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:03.284659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:03.301987 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:03.301970    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:03.318729 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:03.318710    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:04.761365 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:04.761337    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:04.761941 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:04.761922    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:04.779124 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:04.779100    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:04.779226 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:04.779217    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:04.791654 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:04.791634    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:04.807516 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:04.807497    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:06.245594 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:06.245559    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:06.246079 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:06.246063    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:06.258852 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:06.258831    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:06.258985 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:06.258971    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:06.272158 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:06.272138    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:06.286328 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:06.286287    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:07.854657 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:07.854631    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:07.855110 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:07.854871    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:07.869871 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:07.869849    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:07.870052 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:07.869942    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:07.885931 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:07.885909    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:07.901128 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:07.901104    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:09.436051 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:09.436017    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:09.436503 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:09.436437    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:09.455737 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:09.455707    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:09.455982 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:09.455966    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:09.467895 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:09.467878    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:09.484881 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:09.484861    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:10.930767 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:10.930732    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:10.931240 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:10.931028    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:10.946348 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:10.946322    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:10.946348 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:10.946341    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:10.959118 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:10.959090    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:10.973702 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:10.973682    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:12.517761 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:12.517726    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:12.518233 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:12.518100    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:12.532843 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:12.532815    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:12.533027 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:12.532818    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:12.548087 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:12.548064    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:12.562557 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:12.562538    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:14.025928 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:14.025887    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:14.026466 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:14.026446    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:14.038945 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:14.038908    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:14.039153 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:14.038950    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:14.050707 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:14.050676    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:14.064752 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:14.064718    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:15.504089 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:15.504054    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:15.504638 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:15.504467    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:15.527550 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:15.527510    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:15.527700 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:15.527630    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:15.544900 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:15.544876    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:15.561662 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:15.561623    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:16.997831 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:16.997796    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:16.998297 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:16.998110    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:17.010946 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:17.010919    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:17.011151 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:17.011118    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:17.026146 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:17.026126    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:17.041809 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:17.041788    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:18.477408 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:18.477376    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/0.log"
Jul 01 22:33:18.477861 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:18.477839    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-ss4x6_c8265486-1673-49d6-84d3-0c05c2d31299/istio-proxy/1.log"
Jul 01 22:33:18.490127 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:18.490088    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/0.log"
Jul 01 22:33:18.490281 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:18.490155    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-j47sj_4c36b962-8108-4be6-a733-4f58cc918914/istio-proxy/1.log"
Jul 01 22:33:18.501131 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:18.501107    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/main/0.log"
Jul 01 22:33:18.515026 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:18.515009    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz_70d7b504-f4b5-4838-8df9-c3629355aa72/llm-d-routing-sidecar/0.log"
Jul 01 22:33:20.683403 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:20.683372    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kqnw7_6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8/discovery/0.log"
Jul 01 22:33:22.339687 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:22.339659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kqnw7_6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8/discovery/0.log"
Jul 01 22:33:24.006330 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:24.006301    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kqnw7_6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8/discovery/0.log"
Jul 01 22:33:25.685348 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:25.685320    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kqnw7_6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8/discovery/0.log"
Jul 01 22:33:26.692737 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:26.692703    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:26.707291 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:26.707270    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:26.962058 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:26.961980    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:27.968491 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:27.968465    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:27.981626 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:27.981604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:28.229990 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:28.229925    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:29.307895 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:29.307866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:29.321140 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:29.321117    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:29.593799 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:29.593772    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:30.594777 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:30.594725    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:30.608180 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:30.608159    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:30.862780 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:30.862701    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:31.858547 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:31.858516    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:31.875675 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:31.875648    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:32.119604 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:32.119519    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:33.182378 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:33.182352    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:33.195119 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:33.195090    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:33.445527 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:33.445447    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:34.462238 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:34.462208    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:34.496553 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:34.496532    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:34.744793 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:34.744707    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:35.766534 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:35.766507    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:35.779577 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:35.779555    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:36.031815 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:36.031734    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:37.124901 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:37.124871    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:37.138675 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:37.138650    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:37.381554 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:37.381466    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:38.386755 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:38.386728    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:38.401083 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:38.401063    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:38.656071 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:38.655964    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:39.666963 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:39.666933    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:39.682895 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:39.682871    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:39.934170 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:39.934092    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:42.500883 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:42.500850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:33:42.677432 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:42.677392    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:33:42.761900 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:42.761818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:33:45.325231 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:45.325205    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bfr9n_8a5942d3-fea9-4fab-b135-20321b55466f/global-pull-secret-syncer/0.log"
Jul 01 22:33:45.445156 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:45.445129    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log"
Jul 01 22:33:45.583127 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:45.583071    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-117.ec2.internal_01d09e4c13117ae1e640b3f5a139e135/haproxy/0.log"
Jul 01 22:33:48.617462 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:48.617433    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:33:48.688797 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:48.688773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bl2jh_1278a623-a288-481b-840c-34fe79ed2c4e/konnectivity-agent/0.log" limit=1024
Jul 01 22:33:50.363364 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:50.363320    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-nf65n_c1e36cf1-071a-4b8b-a8f9-92243a855c41/authorino/0.log"
Jul 01 22:33:50.405296 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:50.405273    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-s4vc7_c8a4502d-4883-422d-bf98-04777c40e595/manager/0.log"
Jul 01 22:33:50.744273 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:50.744195    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_9ac519ff-13fa-4dd5-97f4-71bcdcec2b1e/manager/0.log"
Jul 01 22:33:52.368431 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.368407    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-wglvf_7de6f364-3d81-4971-8b7e-b94e91780724/kube-state-metrics/0.log"
Jul 01 22:33:52.393301 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.393283    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-wglvf_7de6f364-3d81-4971-8b7e-b94e91780724/kube-rbac-proxy-main/0.log"
Jul 01 22:33:52.416384 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.416364    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-wglvf_7de6f364-3d81-4971-8b7e-b94e91780724/kube-rbac-proxy-self/0.log"
Jul 01 22:33:52.445578 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.445557    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8c7b78f5c-mh7jf_9b427af5-1151-49e3-b456-68d3633ba3be/metrics-server/0.log"
Jul 01 22:33:52.493403 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.493388    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-mnnqk_8c5f4eb0-c973-43e8-a89f-48337b6cbc4f/monitoring-plugin/0.log"
Jul 01 22:33:52.529931 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.529913    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22rcx_7e1bd593-dfdf-4659-9782-07241377de11/node-exporter/0.log"
Jul 01 22:33:52.560447 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.560431    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22rcx_7e1bd593-dfdf-4659-9782-07241377de11/kube-rbac-proxy/0.log"
Jul 01 22:33:52.584748 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.584729    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-22rcx_7e1bd593-dfdf-4659-9782-07241377de11/init-textfile/0.log"
Jul 01 22:33:52.820972 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.820948    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-n6jk2_12c84c6e-fa36-4251-83d6-e4321e010852/kube-rbac-proxy-main/0.log"
Jul 01 22:33:52.850108 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.850082    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-n6jk2_12c84c6e-fa36-4251-83d6-e4321e010852/kube-rbac-proxy-self/0.log"
Jul 01 22:33:52.875019 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:52.874981    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-n6jk2_12c84c6e-fa36-4251-83d6-e4321e010852/openshift-state-metrics/0.log"
Jul 01 22:33:53.099460 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.099436    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-5rmm2_01c8a539-5b78-49f5-b360-f4a5ab3ff48a/prometheus-operator/0.log"
Jul 01 22:33:53.125702 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.125679    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-5rmm2_01c8a539-5b78-49f5-b360-f4a5ab3ff48a/kube-rbac-proxy/0.log"
Jul 01 22:33:53.266090 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.266064    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d97ff7b86-c82n6_66b389f2-bea2-4f6f-8ff1-782354b3a79e/thanos-query/0.log"
Jul 01 22:33:53.288585 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.288564    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d97ff7b86-c82n6_66b389f2-bea2-4f6f-8ff1-782354b3a79e/kube-rbac-proxy-web/0.log"
Jul 01 22:33:53.317623 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.317603    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d97ff7b86-c82n6_66b389f2-bea2-4f6f-8ff1-782354b3a79e/kube-rbac-proxy/0.log"
Jul 01 22:33:53.349067 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.349050    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d97ff7b86-c82n6_66b389f2-bea2-4f6f-8ff1-782354b3a79e/prom-label-proxy/0.log"
Jul 01 22:33:53.380914 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.380867    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d97ff7b86-c82n6_66b389f2-bea2-4f6f-8ff1-782354b3a79e/kube-rbac-proxy-rules/0.log"
Jul 01 22:33:53.406414 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:53.406399    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d97ff7b86-c82n6_66b389f2-bea2-4f6f-8ff1-782354b3a79e/kube-rbac-proxy-metrics/0.log"
Jul 01 22:33:54.849457 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.849430    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"]
Jul 01 22:33:54.852721 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.852702    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:54.855044 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.855024    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z7v9q\"/\"default-dockercfg-pqvjh\""
Jul 01 22:33:54.855923 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.855903    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z7v9q\"/\"kube-root-ca.crt\""
Jul 01 22:33:54.856048 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.855903    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z7v9q\"/\"openshift-service-ca.crt\""
Jul 01 22:33:54.865378 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.865358    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"]
Jul 01 22:33:54.934673 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.934641    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-lib-modules\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:54.934673 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.934674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bgkv\" (UniqueName: \"kubernetes.io/projected/89a554a6-1c7e-4549-9a7d-5d485322d722-kube-api-access-6bgkv\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:54.934909 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.934699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-sys\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:54.934909 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.934805    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-podres\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:54.934909 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:54.934855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-proc\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035407 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035375    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-podres\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035561 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-proc\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035561 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035488    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-lib-modules\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035561 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bgkv\" (UniqueName: \"kubernetes.io/projected/89a554a6-1c7e-4549-9a7d-5d485322d722-kube-api-access-6bgkv\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035561 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035532    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-podres\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035760 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035571    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-proc\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035760 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-sys\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035760 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035649    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-lib-modules\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.035760 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.035728    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a554a6-1c7e-4549-9a7d-5d485322d722-sys\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.043349 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.043331    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bgkv\" (UniqueName: \"kubernetes.io/projected/89a554a6-1c7e-4549-9a7d-5d485322d722-kube-api-access-6bgkv\") pod \"perf-node-gather-daemonset-ddqwn\" (UID: \"89a554a6-1c7e-4549-9a7d-5d485322d722\") " pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.163589 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.163517    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.307064 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.307033    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"]
Jul 01 22:33:55.308081 ip-10-0-132-117 kubenswrapper[2569]: W0701 22:33:55.308053    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod89a554a6_1c7e_4549_9a7d_5d485322d722.slice/crio-f5ba0e6888235451372bedb23615ff369fb7e11a40b93f9946acc1e0bfd4328c WatchSource:0}: Error finding container f5ba0e6888235451372bedb23615ff369fb7e11a40b93f9946acc1e0bfd4328c: Status 404 returned error can't find the container with id f5ba0e6888235451372bedb23615ff369fb7e11a40b93f9946acc1e0bfd4328c
Jul 01 22:33:55.594800 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.594776    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8dbc4859-4xgml_504138a7-6fc0-441e-91f7-e21e143cff8d/console/0.log"
Jul 01 22:33:55.643147 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.643123    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-njh65_37d180c8-3778-4623-956f-b548553fb89c/download-server/0.log"
Jul 01 22:33:55.891446 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.891416    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn" event={"ID":"89a554a6-1c7e-4549-9a7d-5d485322d722","Type":"ContainerStarted","Data":"ba1a658c176134fd5e9021cc13c9d6fb74339603a321f82258b49b4be9edd6c5"}
Jul 01 22:33:55.891785 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.891495    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn" event={"ID":"89a554a6-1c7e-4549-9a7d-5d485322d722","Type":"ContainerStarted","Data":"f5ba0e6888235451372bedb23615ff369fb7e11a40b93f9946acc1e0bfd4328c"}
Jul 01 22:33:55.891785 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.891518    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:33:55.912460 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:55.912415    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn" podStartSLOduration=1.91240065 podStartE2EDuration="1.91240065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:33:55.91050748 +0000 UTC m=+6441.506393797" watchObservedRunningTime="2026-07-01 22:33:55.91240065 +0000 UTC m=+6441.508286964"
Jul 01 22:33:57.270186 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:57.270160    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-snkfr_baef25eb-1d31-4b63-832a-417ae034b11e/dns/0.log"
Jul 01 22:33:57.288511 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:57.288491    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-snkfr_baef25eb-1d31-4b63-832a-417ae034b11e/kube-rbac-proxy/0.log"
Jul 01 22:33:57.316205 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:57.316186    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-772qp_b0fd629a-699a-419f-b1a1-f92355487075/dns-node-resolver/0.log"
Jul 01 22:33:57.931702 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:57.931673    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjncf_7e340c04-4bde-41fc-b23e-1aa34ce58284/node-ca/0.log"
Jul 01 22:33:59.540422 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:33:59.540394    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kqnw7_6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8/discovery/0.log"
Jul 01 22:34:00.203965 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:00.203939    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brdtq_431cee6f-7c0a-4538-a443-824210c58055/serve-healthcheck-canary/0.log"
Jul 01 22:34:00.746263 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:00.746235    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45r8m_56a0c051-e108-48d9-8ac0-3aeef2cead6c/kube-rbac-proxy/0.log"
Jul 01 22:34:00.768830 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:00.768800    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45r8m_56a0c051-e108-48d9-8ac0-3aeef2cead6c/exporter/0.log"
Jul 01 22:34:00.790652 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:00.790632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45r8m_56a0c051-e108-48d9-8ac0-3aeef2cead6c/extractor/0.log"
Jul 01 22:34:01.907191 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:01.907163    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z7v9q/perf-node-gather-daemonset-ddqwn"
Jul 01 22:34:04.625228 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:04.625203    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-67485586b-v6pj6_ce9136bd-2a16-4a9d-ba29-95f96974db4a/manager/0.log"
Jul 01 22:34:04.669786 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:04.669758    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-598d4f65c9-qj6wh_45537f75-4552-4509-a31c-2bb8fdfc6709/manager/0.log"
Jul 01 22:34:04.692666 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:04.692644    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-6txk2_838c590a-c40a-407d-99c4-f3a2c03e1dd5/server/0.log"
Jul 01 22:34:05.210323 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:05.210182    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-ldtzq_9f778b5d-4bbf-481f-8e2f-cdb6e5311e8b/manager/0.log"
Jul 01 22:34:05.297794 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:05.297771    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-grkcn_80ad92ba-e39a-4f95-acef-8766e9f82858/seaweedfs/0.log"
Jul 01 22:34:06.936321 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:06.936293    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kqnw7_6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8/discovery/0.log"
Jul 01 22:34:08.693066 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:08.693021    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kqnw7_6b69f793-1b87-44f2-9ee9-b9b4b1f49eb8/discovery/0.log"
Jul 01 22:34:12.140330 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:12.140304    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrktm_d6b95b10-440c-4b19-a5d3-5a98c20ddb49/kube-multus-additional-cni-plugins/0.log"
Jul 01 22:34:12.163745 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:12.163720    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrktm_d6b95b10-440c-4b19-a5d3-5a98c20ddb49/egress-router-binary-copy/0.log"
Jul 01 22:34:12.187535 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:12.187508    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrktm_d6b95b10-440c-4b19-a5d3-5a98c20ddb49/cni-plugins/0.log"
Jul 01 22:34:12.208395 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:12.208378    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrktm_d6b95b10-440c-4b19-a5d3-5a98c20ddb49/bond-cni-plugin/0.log"
Jul 01 22:34:12.230433 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:12.230415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrktm_d6b95b10-440c-4b19-a5d3-5a98c20ddb49/routeoverride-cni/0.log"
Jul 01 22:34:12.253387 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:12.253366    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrktm_d6b95b10-440c-4b19-a5d3-5a98c20ddb49/whereabouts-cni-bincopy/0.log"
Jul 01 22:34:12.278215 ip-10-0-132-117 kubenswrapper[2569]: I0701 22:34:12.278196    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrktm_d6b95b10-440c-4b19-a5d3-5a98c20ddb49/whereabouts-cni/0.log"