Sep 20 00:47:32.896438 ip-10-0-134-159 systemd[1]: Starting Kubernetes Kubelet...
Sep 20 00:47:33.313286 ip-10-0-134-159 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:33.313286 ip-10-0-134-159 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 20 00:47:33.313286 ip-10-0-134-159 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:33.313286 ip-10-0-134-159 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 20 00:47:33.313286 ip-10-0-134-159 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:33.314355 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.314290    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 20 00:47:33.320707 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320688    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:33.320707 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320703    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:33.320707 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320708    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:33.320707 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320712    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320715    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320718    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320721    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320724    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320727    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320730    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320732    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320735    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320738    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320740    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320743    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320746    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320748    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320751    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320754    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320756    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320759    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320761    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320764    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:33.320858 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320767    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320769    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320772    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320774    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320777    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320779    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320782    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320785    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320787    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320793    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320796    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320798    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320801    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320803    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320808    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320812    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320815    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320818    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320821    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320823    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:33.321349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320826    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320828    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320832    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320834    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320837    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320839    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320842    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320844    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320847    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320851    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320854    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320857    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320860    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320863    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320865    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320868    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320871    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320874    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320876    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:33.321826 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320879    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320882    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320884    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320887    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320889    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320892    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320894    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320898    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320901    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320904    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320907    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320910    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320912    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320915    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320918    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320921    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320923    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320926    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320929    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320931    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:33.322346 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320934    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320938    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320940    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320943    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320946    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320948    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320951    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320953    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320956    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320959    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320961    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320964    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320966    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320969    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320971    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320975    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.320979    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321666    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321673    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:33.322944 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321678    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321681    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321686    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321689    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321692    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321695    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321698    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321701    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321704    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321706    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321709    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321712    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321714    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321717    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321719    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321723    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321726    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321728    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321731    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:33.323429 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321733    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321736    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321738    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321741    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321743    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321746    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321748    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321751    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321754    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321757    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321760    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321763    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321766    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321769    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321771    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321774    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321776    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321778    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321781    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321783    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:33.323954 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321786    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321788    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321791    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321793    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321796    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321798    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321801    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321803    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321805    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321809    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321811    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321814    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321817    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321819    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321822    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321825    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321827    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321830    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321833    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321836    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:33.324459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321838    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321841    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321843    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321846    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321848    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321851    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321854    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321856    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321859    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321861    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321864    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321868    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321870    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321873    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321876    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321879    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321881    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321883    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321886    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321889    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:33.324975 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321891    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321893    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321898    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321901    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321904    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321907    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321909    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321912    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321915    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321917    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321920    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321922    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321926    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321929    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321932    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321935    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321937    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.321940    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322297    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:33.325490 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322302    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322305    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322308    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322312    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322316    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322319    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322322    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322325    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322328    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322331    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322334    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322337    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322340    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322343    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322346    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322352    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322355    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322358    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322361    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:33.325945 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322364    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322366    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322369    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322372    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322374    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322377    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322379    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322382    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322384    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322388    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322391    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322394    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322396    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322399    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322402    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322406    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322409    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322412    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322415    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:33.326437 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322418    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322421    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322424    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322427    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322429    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322432    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322434    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322437    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322439    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322443    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322453    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322456    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322458    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322461    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322463    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322466    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322468    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322471    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322473    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322476    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:33.326903 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322478    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322481    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322483    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322486    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322488    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322491    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322493    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322496    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322498    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322501    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322504    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322506    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322509    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322511    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322514    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322516    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322521    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322524    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322527    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322529    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:33.327424 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322532    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322536    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322539    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322542    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322544    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322547    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322549    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322552    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322554    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322557    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322559    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322562    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322564    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322567    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322569    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322572    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322575    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322577    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322580    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.322582    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322656    2571 flags.go:64] FLAG: --address="0.0.0.0"
Sep 20 00:47:33.327902 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322696    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322703    2571 flags.go:64] FLAG: --anonymous-auth="true"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322708    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322712    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322715    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322719    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322723    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322726    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322729    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322732    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322735    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322738    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322742    2571 flags.go:64] FLAG: --cgroup-root=""
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322745    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322748    2571 flags.go:64] FLAG: --client-ca-file=""
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322751    2571 flags.go:64] FLAG: --cloud-provider="external"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322754    2571 flags.go:64] FLAG: --cluster-dns="[]"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322758    2571 flags.go:64] FLAG: --cluster-domain=""
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322761    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322764    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322767    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322770    2571 flags.go:64] FLAG: --container-log-max-files="5"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322774    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 20 00:47:33.328467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322777    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322780    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322783    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322786    2571 flags.go:64] FLAG: --contention-profiling="false"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322789    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322792    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322795    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322798    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322802    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322805    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322809    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322812    2571 flags.go:64] FLAG: --enable-load-reader="false"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322815    2571 flags.go:64] FLAG: --enable-server="true"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322818    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322822    2571 flags.go:64] FLAG: --event-burst="100"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322825    2571 flags.go:64] FLAG: --event-qps="50"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322828    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322831    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322834    2571 flags.go:64] FLAG: --eviction-hard=""
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322838    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322841    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322845    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322848    2571 flags.go:64] FLAG: --eviction-soft=""
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322851    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322854    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 20 00:47:33.329015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322857    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322860    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322863    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322866    2571 flags.go:64] FLAG: --fail-swap-on="true"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322869    2571 flags.go:64] FLAG: --feature-gates=""
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322872    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322876    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322879    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322882    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322885    2571 flags.go:64] FLAG: --healthz-port="10248"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322888    2571 flags.go:64] FLAG: --help="false"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322891    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322894    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322897    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322900    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322903    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322906    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322909    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322912    2571 flags.go:64] FLAG: --image-service-endpoint=""
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322915    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322918    2571 flags.go:64] FLAG: --kube-api-burst="100"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322921    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322924    2571 flags.go:64] FLAG: --kube-api-qps="50"
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322927    2571 flags.go:64] FLAG: --kube-reserved=""
Sep 20 00:47:33.329666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322930    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322933    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322936    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322939    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322943    2571 flags.go:64] FLAG: --lock-file=""
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322946    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322948    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322952    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322958    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322961    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322964    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322967    2571 flags.go:64] FLAG: --logging-format="text"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322969    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322973    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322976    2571 flags.go:64] FLAG: --manifest-url=""
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322978    2571 flags.go:64] FLAG: --manifest-url-header=""
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322983    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322985    2571 flags.go:64] FLAG: --max-open-files="1000000"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.322989    2571 flags.go:64] FLAG: --max-pods="110"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323011    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323015    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323018    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323021    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323024    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323027    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 20 00:47:33.330263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323031    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323038    2571 flags.go:64] FLAG: --node-status-max-images="50"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323041    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323044    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323047    2571 flags.go:64] FLAG: --pod-cidr=""
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323050    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323054    2571 flags.go:64] FLAG: --pod-manifest-path=""
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323057    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323060    2571 flags.go:64] FLAG: --pods-per-core="0"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323063    2571 flags.go:64] FLAG: --port="10250"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323066    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323069    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051af48fd55f423ce"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323073    2571 flags.go:64] FLAG: --qos-reserved=""
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323076    2571 flags.go:64] FLAG: --read-only-port="10255"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323079    2571 flags.go:64] FLAG: --register-node="true"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323081    2571 flags.go:64] FLAG: --register-with-taints=""
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323085    2571 flags.go:64] FLAG: --registry-burst="10"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323088    2571 flags.go:64] FLAG: --registry-qps="5"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323091    2571 flags.go:64] FLAG: --reserved-cpus=""
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323094    2571 flags.go:64] FLAG: --reserved-memory=""
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323097    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323100    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323103    2571 flags.go:64] FLAG: --rotate-certificates="false"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323106    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323109    2571 flags.go:64] FLAG: --runonce="false"
Sep 20 00:47:33.330877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323112    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323115    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323117    2571 flags.go:64] FLAG: --seccomp-default="false"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323120    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323123    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323126    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323129    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323133    2571 flags.go:64] FLAG: --storage-driver-password="root"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323136    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323139    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323141    2571 flags.go:64] FLAG: --storage-driver-user="root"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323144    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323147    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323150    2571 flags.go:64] FLAG: --system-cgroups=""
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323153    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323158    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323161    2571 flags.go:64] FLAG: --tls-cert-file=""
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323164    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323182    2571 flags.go:64] FLAG: --tls-min-version=""
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323185    2571 flags.go:64] FLAG: --tls-private-key-file=""
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323188    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323207    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323210    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323213    2571 flags.go:64] FLAG: --v="2"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323217    2571 flags.go:64] FLAG: --version="false"
Sep 20 00:47:33.331512 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323221    2571 flags.go:64] FLAG: --vmodule=""
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323225    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323228    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323355    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323359    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323362    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323365    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323368    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323371    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323374    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323378    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323382    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323385    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323388    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323393    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323396    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323398    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323401    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323404    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:33.332160 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323406    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323409    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323411    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323414    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323417    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323420    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323422    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323425    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323427    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323430    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323433    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323435    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323438    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323441    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323444    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323447    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323449    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323452    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323454    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323457    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:33.332642 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323459    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323462    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323465    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323467    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323469    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323472    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323474    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323478    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323481    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323483    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323486    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323489    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323491    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323494    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323496    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323499    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323503    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323507    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323510    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323515    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:33.333128 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323517    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323520    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323522    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323525    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323527    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323531    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323535    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323539    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323542    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323546    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323549    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323551    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323554    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323556    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323559    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323562    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323564    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323566    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323569    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:33.333629 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323573    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323576    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323578    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323581    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323583    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323586    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323589    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323591    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323594    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323597    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323599    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323601    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323606    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323608    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323611    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323613    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323616    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323619    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323621    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323624    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:33.334081 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323626    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323629    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323632    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.323634    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.323639    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.330816    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.330831    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.331719    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.331727    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331786    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331791    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331794    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331797    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331800    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331803    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:33.334584 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331806    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331809    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331812    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331815    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331818    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331821    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331824    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331826    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331829    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331832    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331834    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331837    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331840    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331842    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331845    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331847    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331850    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331852    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331857    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:33.334964 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331860    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331863    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331866    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331869    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331883    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331887    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331890    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331894    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331896    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331899    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331902    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331904    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331907    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331909    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331912    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331915    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331918    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331921    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331925    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:33.335459 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331928    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331931    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331933    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331936    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331939    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331942    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331944    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331947    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331950    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331953    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331956    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331958    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331961    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331964    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331966    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331969    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331971    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331974    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331983    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331986    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:33.335913 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331988    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331991    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331993    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331996    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.331999    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332001    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332004    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332006    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332009    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332012    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332014    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332016    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332019    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332022    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332024    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332027    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332029    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332032    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332035    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332037    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:33.336421 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332040    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332043    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332045    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332048    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332050    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332053    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332055    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332058    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332061    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332063    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332066    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332074    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332077    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332080    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332082    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:33.336911 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.332087    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332246    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332252    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332256    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332259    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332262    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332265    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332269    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332273    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332275    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332278    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332281    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332283    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332286    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332289    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332292    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332294    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332297    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332299    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332302    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:33.337343 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332305    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332307    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332310    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332312    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332315    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332318    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332321    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332323    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332326    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332334    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332337    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332340    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332343    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332345    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332348    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332351    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332353    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332356    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332358    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332361    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:33.337824 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332364    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332366    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332369    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332371    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332374    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332376    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332379    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332382    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332384    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332387    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332389    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332392    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332395    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332397    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332400    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332402    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332405    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332407    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332411    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332413    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:33.338335 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332416    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332418    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332426    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332429    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332432    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332434    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332437    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332439    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332442    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332444    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332447    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332449    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332452    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332454    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332457    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332459    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332462    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332464    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332467    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332469    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:33.338855 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332471    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332474    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332477    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332479    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332482    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332484    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332486    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332490    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332494    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332496    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332500    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332504    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332507    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332510    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332513    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332521    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332524    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332527    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332529    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:33.339365 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:33.332532    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:33.339818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.332536    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:33.339818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.332641    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 20 00:47:33.339818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.334902    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 20 00:47:33.339818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.335910    2571 server.go:1019] "Starting client certificate rotation"
Sep 20 00:47:33.339818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.336036    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 00:47:33.339818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.336741    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 00:47:33.339818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.338640    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 00:47:33.339992 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.339937    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 00:47:33.351958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.351942    2571 log.go:25] "Validated CRI v1 runtime API"
Sep 20 00:47:33.354259 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.354243    2571 log.go:25] "Validated CRI v1 image API"
Sep 20 00:47:33.354995 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.354980    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 20 00:47:33.357321 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.357305    2571 fs.go:135] Filesystem UUIDs: map[141d0858-e3f2-411a-8d9c-7a64338858ae:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c3a86090-2ad3-41a6-a073-7f01f7c01107:/dev/nvme0n1p4]
Sep 20 00:47:33.357368 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.357321    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 20 00:47:33.363294 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.363182    2571 manager.go:216] Machine: {Timestamp:2026-09-20 00:47:33.36175517 +0000 UTC m=+0.355030695 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103372 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d917e59d2720d98f57edc0c35604e SystemUUID:ec2d917e-59d2-720d-98f5-7edc0c35604e BootID:b85d67ad-8794-4f41-b727-26c647e16931 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ce:bc:6b:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ce:bc:6b:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:da:f7:d2:e8:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 20 00:47:33.363294 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.363289    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 20 00:47:33.363392 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.363354    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 20 00:47:33.366663 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.366635    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 20 00:47:33.366795 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.366667    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 20 00:47:33.367793 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.367780    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 00:47:33.368113 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.368101    2571 topology_manager.go:138] "Creating topology manager with none policy"
Sep 20 00:47:33.368153 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.368118    2571 container_manager_linux.go:309] "Creating device plugin manager"
Sep 20 00:47:33.368153 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.368126    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 00:47:33.368922 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.368911    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 00:47:33.368984 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.368976    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 20 00:47:33.373368 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373356    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 00:47:33.373477 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373468    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 20 00:47:33.373506 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373497    2571 kubelet.go:486] "Attempting to sync node with API server"
Sep 20 00:47:33.373532 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373506    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 20 00:47:33.373532 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373523    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 20 00:47:33.373532 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373531    2571 kubelet.go:398] "Adding apiserver pod source"
Sep 20 00:47:33.373628 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373539    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 20 00:47:33.373861 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373850    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 00:47:33.373900 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.373868    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 00:47:33.376302 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.376287    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 20 00:47:33.379236 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.379223    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 20 00:47:33.379282 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.379252    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 20 00:47:33.380614 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380599    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 20 00:47:33.380675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380622    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 20 00:47:33.380675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380629    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 20 00:47:33.380675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380634    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 20 00:47:33.380675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380642    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 20 00:47:33.380675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380649    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 20 00:47:33.380675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380665    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 20 00:47:33.380675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380671    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 20 00:47:33.380968 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380686    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 20 00:47:33.380968 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380692    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 20 00:47:33.380968 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380714    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 20 00:47:33.380968 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.380719    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 20 00:47:33.381908 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.381896    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 20 00:47:33.381908 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.381905    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 20 00:47:33.383761 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.383739    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 20 00:47:33.386068 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.383752    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 20 00:47:33.386289 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.386260    2571 server.go:1268] "Started kubelet"
Sep 20 00:47:33.387288 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.387257    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 20 00:47:33.387372 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.387306    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 20 00:47:33.387509 ip-10-0-134-159 systemd[1]: Started Kubernetes Kubelet.
Sep 20 00:47:33.388488 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.387373    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 20 00:47:33.388570 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.388473    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l6qh9"
Sep 20 00:47:33.390032 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.389751    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 20 00:47:33.391483 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.391445    2571 server.go:310] "Adding debug handlers to kubelet server"
Sep 20 00:47:33.392142 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.392097    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 20 00:47:33.393333 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.393310    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 20 00:47:33.394664 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.394643    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l6qh9"
Sep 20 00:47:33.396997 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.395883    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-159.ec2.internal.18d6e0f6ffe40de1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-159.ec2.internal,UID:ip-10-0-134-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-159.ec2.internal,},FirstTimestamp:2026-09-20 00:47:33.386063329 +0000 UTC m=+0.379338855,LastTimestamp:2026-09-20 00:47:33.386063329 +0000 UTC m=+0.379338855,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-159.ec2.internal,}"
Sep 20 00:47:33.398358 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.398341    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 20 00:47:33.398946 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.398932    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 20 00:47:33.399044 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.399020    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:33.399691 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399672    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 20 00:47:33.399765 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399702    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 20 00:47:33.399765 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399708    2571 factory.go:55] Registering systemd factory
Sep 20 00:47:33.399765 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399720    2571 factory.go:223] Registration of the systemd container factory successfully
Sep 20 00:47:33.399765 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399681    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 20 00:47:33.399963 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399824    2571 reconstruct.go:97] "Volume reconstruction finished"
Sep 20 00:47:33.399963 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399833    2571 reconciler.go:29] "Reconciler: start to sync state"
Sep 20 00:47:33.399963 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399938    2571 factory.go:153] Registering CRI-O factory
Sep 20 00:47:33.399963 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399947    2571 factory.go:223] Registration of the crio container factory successfully
Sep 20 00:47:33.400146 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399985    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 20 00:47:33.400146 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.399997    2571 factory.go:103] Registering Raw factory
Sep 20 00:47:33.400146 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.400009    2571 manager.go:1196] Started watching for new ooms in manager
Sep 20 00:47:33.400425 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.400410    2571 manager.go:349] Starting recovery of all containers
Sep 20 00:47:33.408215 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.408178    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:33.409683 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.409667    2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-159.ec2.internal\" not found" node="ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.412458 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.412441    2571 manager.go:354] Recovery completed
Sep 20 00:47:33.417712 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.417698    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:33.419178 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.419164    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:33.419254 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.419231    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:33.419254 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.419247    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:33.419736 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.419722    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 20 00:47:33.419736 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.419734    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 20 00:47:33.419830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.419748    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 00:47:33.419830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.419794    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:33.420473 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.420457    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:33.420532 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.420485    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:33.420532 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.420496    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:33.421830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.421805    2571 policy_none.go:49] "None policy: Start"
Sep 20 00:47:33.421830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.421828    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 20 00:47:33.421922 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.421838    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 20 00:47:33.423874 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.423858    2571 policy_none.go:47] "Start"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.464712    2571 manager.go:337] "Starting Device Plugin manager"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.464761    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.464772    2571 server.go:87] "Starting device plugin registration server"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.464974    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.464985    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.465084    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.465184    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.465206    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.465844    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 20 00:47:33.479877 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.465886    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:33.501090 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.501064    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 20 00:47:33.502217 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.502185    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 20 00:47:33.502298 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.502251    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 20 00:47:33.502298 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.502269    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 20 00:47:33.502446 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.502305    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 20 00:47:33.503815 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.503795    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:33.565076 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.565032    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:33.565741 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.565727    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:33.565837 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.565756    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:33.565837 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.565770    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:33.565837 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.565795    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.571485 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.571469    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.571485 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.571486    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-159.ec2.internal\": node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:33.585463 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.585443    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:33.603241 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.603220    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal"]
Sep 20 00:47:33.603312 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.603270    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:33.605070 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.605056    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:33.605130 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.605085    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:33.605130 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.605097    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:33.607324 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.607312    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:33.607450 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.607438    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.607482 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.607467    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:33.607960 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.607947    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:33.608012 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.607974    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:33.608012 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.607984    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:33.608826 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.608813    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:33.608880 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.608836    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:33.608880 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.608846    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:33.610141 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.610122    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.610238 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.610145    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:33.610806 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.610791    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:33.610874 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.610816    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:33.610874 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.610827    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:33.634743 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.634724    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-159.ec2.internal\" not found" node="ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.639054 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.639039    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-159.ec2.internal\" not found" node="ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.686426 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.686316    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:33.787288 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.787263    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:33.801640 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.801618    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c0b85168aed422541119cd2b668d6e09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal\" (UID: \"c0b85168aed422541119cd2b668d6e09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.801732 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.801648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0b85168aed422541119cd2b668d6e09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal\" (UID: \"c0b85168aed422541119cd2b668d6e09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.801732 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.801675    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa5c61b1f5e26b2389ad9ed376a58f2d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-159.ec2.internal\" (UID: \"fa5c61b1f5e26b2389ad9ed376a58f2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.887997 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.887943    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:33.902269 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.902248    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c0b85168aed422541119cd2b668d6e09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal\" (UID: \"c0b85168aed422541119cd2b668d6e09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.902329 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.902283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0b85168aed422541119cd2b668d6e09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal\" (UID: \"c0b85168aed422541119cd2b668d6e09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.902329 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.902309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa5c61b1f5e26b2389ad9ed376a58f2d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-159.ec2.internal\" (UID: \"fa5c61b1f5e26b2389ad9ed376a58f2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.902395 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.902357    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa5c61b1f5e26b2389ad9ed376a58f2d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-159.ec2.internal\" (UID: \"fa5c61b1f5e26b2389ad9ed376a58f2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.902395 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.902372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0b85168aed422541119cd2b668d6e09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal\" (UID: \"c0b85168aed422541119cd2b668d6e09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.902456 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.902358    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c0b85168aed422541119cd2b668d6e09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal\" (UID: \"c0b85168aed422541119cd2b668d6e09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.939394 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.939370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.942545 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:33.942526    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:33.988659 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:33.988627    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.089115 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.089083    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.189658 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.189611    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.290087 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.290065    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.335502 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.335480    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 20 00:47:34.335839 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.335600    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 20 00:47:34.335839 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.335647    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 20 00:47:34.390742 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.390726    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.402483 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.402459    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-19 00:42:33 +0000 UTC" deadline="2028-03-06 21:23:32.751686163 +0000 UTC"
Sep 20 00:47:34.402483 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.402481    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12812h35m58.349207905s"
Sep 20 00:47:34.491068 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.491015    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.517504 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:34.517478    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b85168aed422541119cd2b668d6e09.slice/crio-82e8bc70d3713dc0df205ac1914973375ed84b77ff3a648b84dba03e097225a1 WatchSource:0}: Error finding container 82e8bc70d3713dc0df205ac1914973375ed84b77ff3a648b84dba03e097225a1: Status 404 returned error can't find the container with id 82e8bc70d3713dc0df205ac1914973375ed84b77ff3a648b84dba03e097225a1
Sep 20 00:47:34.517857 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:34.517836    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5c61b1f5e26b2389ad9ed376a58f2d.slice/crio-1c5a45e201b7ab5f9fe6c29f423128b1cb8f611f20ecea4a941f5ee0cf6c2815 WatchSource:0}: Error finding container 1c5a45e201b7ab5f9fe6c29f423128b1cb8f611f20ecea4a941f5ee0cf6c2815: Status 404 returned error can't find the container with id 1c5a45e201b7ab5f9fe6c29f423128b1cb8f611f20ecea4a941f5ee0cf6c2815
Sep 20 00:47:34.521762 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.521744    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:47:34.591232 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.591214    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.603056 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.603040    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:34.692023 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.692002    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.792362 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:34.792311    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-159.ec2.internal\" not found"
Sep 20 00:47:34.829471 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.829381    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:34.899087 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.899052    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:34.909294 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.909271    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 00:47:34.910277 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.910246    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal"
Sep 20 00:47:34.915542 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:34.915499    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 00:47:35.141858 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.141791    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:35.317332 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.317307    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:35.375516 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.375488    2571 apiserver.go:52] "Watching apiserver"
Sep 20 00:47:35.381922 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.381904    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 20 00:47:35.382315 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.382287    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pv6x5","openshift-ovn-kubernetes/ovnkube-node-pzbh7","kube-system/global-pull-secret-syncer-p8hhh","kube-system/konnectivity-agent-6js95","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg","openshift-dns/node-resolver-529k4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal","openshift-multus/multus-additional-cni-plugins-h59fj","openshift-multus/multus-k4w8t","openshift-multus/network-metrics-daemon-9brst","kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wxrgs","openshift-image-registry/node-ca-6qd5c","openshift-network-diagnostics/network-check-target-w5xk8"]
Sep 20 00:47:35.384466 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.384447    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:35.384550 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.384523    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:35.386412 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.386396    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.388362 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.388345    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.388451 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.388421    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:35.388718 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.388699    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 20 00:47:35.388785 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.388758    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 20 00:47:35.388833 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.388796    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 20 00:47:35.389012 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.388997    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg88r\""
Sep 20 00:47:35.390355 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.390336    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.392280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.392228    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 20 00:47:35.392280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.392256    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v9vp5\""
Sep 20 00:47:35.392404 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.392360    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.392469 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.392454    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 20 00:47:35.394776 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.394427    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.394881 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.394865    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 20 00:47:35.394967 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.394916    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 20 00:47:35.394967 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.394930    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dcxwc\""
Sep 20 00:47:35.395066 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.395001    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 20 00:47:35.396584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.396470    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.396584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.396536    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 20 00:47:35.396584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.396573    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 20 00:47:35.396756 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.396714    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkstd\""
Sep 20 00:47:35.398816 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.398801    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 20 00:47:35.398900 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.398837    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g87nl\""
Sep 20 00:47:35.399917 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.399367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:35.399917 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.399392    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 20 00:47:35.399917 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.399443    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:35.399917 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.399545    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 20 00:47:35.399917 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.399845    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 20 00:47:35.400671 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.400655    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 20 00:47:35.402150 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.402133    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.404208 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.404176    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xgpnh\""
Sep 20 00:47:35.404384 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.404369    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 20 00:47:35.404443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.404401    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 20 00:47:35.404639 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.404620    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 20 00:47:35.405100 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.405043    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 20 00:47:35.405100 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.405095    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.405253 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.405223    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 20 00:47:35.405305 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.405251    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 20 00:47:35.407234 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.407215    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:35.407378 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.407360    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:35.407449 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.407408    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 20 00:47:35.407612 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.407589    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r7q4k\""
Sep 20 00:47:35.407858 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.407844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.409946 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.409929    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.410029 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.409972    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-cni-multus\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410029 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b7adc32-efec-40b0-94e9-e8649ba5acff-agent-certs\") pod \"konnectivity-agent-6js95\" (UID: \"0b7adc32-efec-40b0-94e9-e8649ba5acff\") " pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.410029 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-env-overrides\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410177 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410045    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-sys-fs\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.410177 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410067    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-ovn\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410177 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:35.410177 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:35.410177 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86f225a2-931e-4088-b8d2-edbe0ca0406a-host\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.410177 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-cni-binary-copy\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-k8s-cni-cncf-io\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-conf-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410247    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgwrb\" (UniqueName: \"kubernetes.io/projected/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-kube-api-access-cgwrb\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410270    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-system-cni-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-cnibin\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-etc-kubernetes\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410361    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-cni-bin\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410401    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-78xwx\""
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89d96c9f-5938-4fae-8377-4623f781d451-kubelet-config\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.410459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410458    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410480    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-log-socket\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-cni-netd\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86f225a2-931e-4088-b8d2-edbe0ca0406a-serviceca\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-cni-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-multus-certs\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410596    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-var-lib-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-slash\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-etc-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-socket-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-kubelet\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-registration-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410768    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410789    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/86f225a2-931e-4088-b8d2-edbe0ca0406a-kube-api-access-dzqzk\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c2c95f9-a162-46df-96e8-6397b7bcb58c-hosts-file\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.410950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-cni-bin\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410873    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-hostroot\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-ovnkube-script-lib\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b7adc32-efec-40b0-94e9-e8649ba5acff-konnectivity-ca\") pod \"konnectivity-agent-6js95\" (UID: \"0b7adc32-efec-40b0-94e9-e8649ba5acff\") " pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410948    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lkxl\" (UniqueName: \"kubernetes.io/projected/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-kube-api-access-2lkxl\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410975    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2lh9\" (UniqueName: \"kubernetes.io/projected/9c2c95f9-a162-46df-96e8-6397b7bcb58c-kube-api-access-g2lh9\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.410996    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-systemd\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2bj\" (UniqueName: \"kubernetes.io/projected/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-kube-api-access-4t2bj\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-netns\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-node-log\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77831236-c544-497a-89ad-d352f3a8b1ab-ovn-node-metrics-cert\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2q92\" (UniqueName: \"kubernetes.io/projected/77831236-c544-497a-89ad-d352f3a8b1ab-kube-api-access-q2q92\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411186    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411220    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-systemd-units\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-run-netns\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.411686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-daemon-config\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.412280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89d96c9f-5938-4fae-8377-4623f781d451-dbus\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.412280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411308    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-device-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.412280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-socket-dir-parent\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.412280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-kubelet\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.412280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411393    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-ovnkube-config\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.412280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.411452    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2c95f9-a162-46df-96e8-6397b7bcb58c-tmp-dir\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.412605 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.412584    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:35.412676 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.412635    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pcz79\""
Sep 20 00:47:35.412676 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.412657    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:35.429247 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.429226    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jpcpz"
Sep 20 00:47:35.437282 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.437265    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jpcpz"
Sep 20 00:47:35.501119 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.501095    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 20 00:47:35.506303 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.506270    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal" event={"ID":"c0b85168aed422541119cd2b668d6e09","Type":"ContainerStarted","Data":"82e8bc70d3713dc0df205ac1914973375ed84b77ff3a648b84dba03e097225a1"}
Sep 20 00:47:35.507391 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.507372    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal" event={"ID":"fa5c61b1f5e26b2389ad9ed376a58f2d","Type":"ContainerStarted","Data":"1c5a45e201b7ab5f9fe6c29f423128b1cb8f611f20ecea4a941f5ee0cf6c2815"}
Sep 20 00:47:35.511588 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-netns\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.511683 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-node-log\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.511683 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77831236-c544-497a-89ad-d352f3a8b1ab-ovn-node-metrics-cert\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.511683 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2q92\" (UniqueName: \"kubernetes.io/projected/77831236-c544-497a-89ad-d352f3a8b1ab-kube-api-access-q2q92\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.511683 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-systemd-units\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511686    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-netns\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-run-netns\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-node-log\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-daemon-config\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89d96c9f-5938-4fae-8377-4623f781d451-dbus\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-device-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511802    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-run-netns\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511834    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-socket-dir-parent\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.511869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511863    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-kubelet\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-ovnkube-config\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2c95f9-a162-46df-96e8-6397b7bcb58c-tmp-dir\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511948    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-systemd-units\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-socket-dir-parent\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89d96c9f-5938-4fae-8377-4623f781d451-dbus\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-kubelet\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-var-lib-kubelet\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4d496d1-4515-4028-968d-bed88bddf477-etc-tuned\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.512171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512154    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-cni-multus\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b7adc32-efec-40b0-94e9-e8649ba5acff-agent-certs\") pod \"konnectivity-agent-6js95\" (UID: \"0b7adc32-efec-40b0-94e9-e8649ba5acff\") " pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512217    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-env-overrides\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512203    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-sys-fs\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-system-cni-dir\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsmzx\" (UniqueName: \"kubernetes.io/projected/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-kube-api-access-xsmzx\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-systemd\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512325    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-ovn\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512370    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86f225a2-931e-4088-b8d2-edbe0ca0406a-host\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512394    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-daemon-config\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-cni-binary-copy\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-k8s-cni-cncf-io\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.511864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-device-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-conf-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512506    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-ovn\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86f225a2-931e-4088-b8d2-edbe0ca0406a-host\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512538    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-conf-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512608    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-ovnkube-config\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512649    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cni-binary-copy\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512660    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-sys-fs\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgwrb\" (UniqueName: \"kubernetes.io/projected/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-kube-api-access-cgwrb\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512689    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-cni-multus\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.512760    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysconfig\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysctl-d\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysctl-conf\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.512878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-system-cni-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-cnibin\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-cni-binary-copy\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-etc-kubernetes\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512987    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-cnibin\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.512996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-k8s-cni-cncf-io\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.513082    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs podName:8a92ad3c-5004-4ec6-a9b0-30d474ee931e nodeName:}" failed. No retries permitted until 2026-09-20 00:47:36.013047576 +0000 UTC m=+3.006323107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs") pod "network-metrics-daemon-9brst" (UID: "8a92ad3c-5004-4ec6-a9b0-30d474ee931e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513228    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-system-cni-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-cni-bin\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513287    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-etc-kubernetes\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513292    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-env-overrides\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89d96c9f-5938-4fae-8377-4623f781d451-kubelet-config\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-kubernetes\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2015f96-1229-4720-9f8c-3ddb6a61bda4-host-slash\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-log-socket\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.513577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513444    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-cni-bin\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-cni-netd\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.513478    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513494    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89d96c9f-5938-4fae-8377-4623f781d451-kubelet-config\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86f225a2-931e-4088-b8d2-edbe0ca0406a-serviceca\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513549    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-cni-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-multus-certs\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513574    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-log-socket\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-var-lib-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513613    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513634    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-multus-cni-dir\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513639    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-sys\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-var-lib-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp8j5\" (UniqueName: \"kubernetes.io/projected/c4d496d1-4515-4028-968d-bed88bddf477-kube-api-access-pp8j5\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-run-multus-certs\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513728    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-slash\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-etc-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.514366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c2c95f9-a162-46df-96e8-6397b7bcb58c-tmp-dir\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-socket-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513858    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-slash\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513866    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-cni-netd\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cnibin\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513897    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513917    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-run\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.513949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-modprobe-d\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.513994    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret podName:89d96c9f-5938-4fae-8377-4623f781d451 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:36.013978087 +0000 UTC m=+3.007253596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret") pod "global-pull-secret-syncer-p8hhh" (UID: "89d96c9f-5938-4fae-8377-4623f781d451") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514025    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-kubelet\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-registration-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514064    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-socket-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86f225a2-931e-4088-b8d2-edbe0ca0406a-serviceca\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-etc-openvswitch\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514106    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-registration-dir\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2015f96-1229-4720-9f8c-3ddb6a61bda4-iptables-alerter-script\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514159    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-kubelet\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/86f225a2-931e-4088-b8d2-edbe0ca0406a-kube-api-access-dzqzk\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514252    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514284    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c2c95f9-a162-46df-96e8-6397b7bcb58c-hosts-file\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-host\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-cni-bin\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c2c95f9-a162-46df-96e8-6397b7bcb58c-hosts-file\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514395    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-hostroot\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-host-var-lib-cni-bin\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-ovnkube-script-lib\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514465    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b7adc32-efec-40b0-94e9-e8649ba5acff-konnectivity-ca\") pod \"konnectivity-agent-6js95\" (UID: \"0b7adc32-efec-40b0-94e9-e8649ba5acff\") " pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514497    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-hostroot\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lkxl\" (UniqueName: \"kubernetes.io/projected/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-kube-api-access-2lkxl\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2lh9\" (UniqueName: \"kubernetes.io/projected/9c2c95f9-a162-46df-96e8-6397b7bcb58c-kube-api-access-g2lh9\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514614    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhg2m\" (UniqueName: \"kubernetes.io/projected/a2015f96-1229-4720-9f8c-3ddb6a61bda4-kube-api-access-hhg2m\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.515788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-systemd\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514693    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514720    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2bj\" (UniqueName: \"kubernetes.io/projected/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-kube-api-access-4t2bj\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514769    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-lib-modules\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4d496d1-4515-4028-968d-bed88bddf477-tmp\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-run-systemd\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514981    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77831236-c544-497a-89ad-d352f3a8b1ab-ovnkube-script-lib\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.514982    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b7adc32-efec-40b0-94e9-e8649ba5acff-konnectivity-ca\") pod \"konnectivity-agent-6js95\" (UID: \"0b7adc32-efec-40b0-94e9-e8649ba5acff\") " pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.515088    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.515125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77831236-c544-497a-89ad-d352f3a8b1ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.515929    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77831236-c544-497a-89ad-d352f3a8b1ab-ovn-node-metrics-cert\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.516347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.515953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b7adc32-efec-40b0-94e9-e8649ba5acff-agent-certs\") pod \"konnectivity-agent-6js95\" (UID: \"0b7adc32-efec-40b0-94e9-e8649ba5acff\") " pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.518800 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.518779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2q92\" (UniqueName: \"kubernetes.io/projected/77831236-c544-497a-89ad-d352f3a8b1ab-kube-api-access-q2q92\") pod \"ovnkube-node-pzbh7\" (UID: \"77831236-c544-497a-89ad-d352f3a8b1ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.519934 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.519917    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:35.520006 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.519938    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:35.520006 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.519950    2571 projected.go:196] Error preparing data for projected volume kube-api-access-n2nnx for pod openshift-network-diagnostics/network-check-target-w5xk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:35.520006 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:35.520000    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx podName:cb1186e9-9378-4dbe-bf23-bba1b4cf75c7 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:36.019985423 +0000 UTC m=+3.013260946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n2nnx" (UniqueName: "kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx") pod "network-check-target-w5xk8" (UID: "cb1186e9-9378-4dbe-bf23-bba1b4cf75c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:35.522166 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.522124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgwrb\" (UniqueName: \"kubernetes.io/projected/b8e070d0-7f29-4f45-a2aa-c3f6e62823a9-kube-api-access-cgwrb\") pod \"multus-k4w8t\" (UID: \"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9\") " pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.523175 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.523150    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/86f225a2-931e-4088-b8d2-edbe0ca0406a-kube-api-access-dzqzk\") pod \"node-ca-6qd5c\" (UID: \"86f225a2-931e-4088-b8d2-edbe0ca0406a\") " pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.523317 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.523235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lkxl\" (UniqueName: \"kubernetes.io/projected/5456db52-27f7-4aa9-b9ed-2a1dabac5e0b-kube-api-access-2lkxl\") pod \"aws-ebs-csi-driver-node-q6scg\" (UID: \"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.523454 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.523433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2lh9\" (UniqueName: \"kubernetes.io/projected/9c2c95f9-a162-46df-96e8-6397b7bcb58c-kube-api-access-g2lh9\") pod \"node-resolver-529k4\" (UID: \"9c2c95f9-a162-46df-96e8-6397b7bcb58c\") " pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.524006 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.523989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2bj\" (UniqueName: \"kubernetes.io/projected/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-kube-api-access-4t2bj\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:35.615958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.615923    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2015f96-1229-4720-9f8c-3ddb6a61bda4-iptables-alerter-script\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.615958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.615958    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.616180 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.615972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-host\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616180 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhg2m\" (UniqueName: \"kubernetes.io/projected/a2015f96-1229-4720-9f8c-3ddb6a61bda4-kube-api-access-hhg2m\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.616180 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-lib-modules\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616180 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4d496d1-4515-4028-968d-bed88bddf477-tmp\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616180 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-var-lib-kubelet\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616180 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616131    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-host\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616180 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4d496d1-4515-4028-968d-bed88bddf477-etc-tuned\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-system-cni-dir\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsmzx\" (UniqueName: \"kubernetes.io/projected/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-kube-api-access-xsmzx\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-systemd\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616311    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cni-binary-copy\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-lib-modules\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysconfig\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysctl-d\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysctl-conf\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-kubernetes\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2015f96-1229-4720-9f8c-3ddb6a61bda4-host-slash\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-sys\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.616529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp8j5\" (UniqueName: \"kubernetes.io/projected/c4d496d1-4515-4028-968d-bed88bddf477-kube-api-access-pp8j5\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cnibin\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-var-lib-kubelet\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-run\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-modprobe-d\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2015f96-1229-4720-9f8c-3ddb6a61bda4-host-slash\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616675    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-system-cni-dir\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616718    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cnibin\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616781    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616792    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysconfig\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2015f96-1229-4720-9f8c-3ddb6a61bda4-iptables-alerter-script\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysctl-d\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-systemd\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-sys\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616865    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-modprobe-d\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616867    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-kubernetes\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-run\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617932 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616952    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.617932 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.616962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4d496d1-4515-4028-968d-bed88bddf477-etc-sysctl-conf\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.617932 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.617173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-cni-binary-copy\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.617932 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.617873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4d496d1-4515-4028-968d-bed88bddf477-tmp\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.618134 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.618028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4d496d1-4515-4028-968d-bed88bddf477-etc-tuned\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.625580 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.625547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsmzx\" (UniqueName: \"kubernetes.io/projected/2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8-kube-api-access-xsmzx\") pod \"multus-additional-cni-plugins-h59fj\" (UID: \"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8\") " pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.625580 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.625566    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhg2m\" (UniqueName: \"kubernetes.io/projected/a2015f96-1229-4720-9f8c-3ddb6a61bda4-kube-api-access-hhg2m\") pod \"iptables-alerter-pv6x5\" (UID: \"a2015f96-1229-4720-9f8c-3ddb6a61bda4\") " pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.626484 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.626462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp8j5\" (UniqueName: \"kubernetes.io/projected/c4d496d1-4515-4028-968d-bed88bddf477-kube-api-access-pp8j5\") pod \"tuned-wxrgs\" (UID: \"c4d496d1-4515-4028-968d-bed88bddf477\") " pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:35.698503 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.698447    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qd5c"
Sep 20 00:47:35.706596 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.706580    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:35.716021 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.716003    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg"
Sep 20 00:47:35.720390 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.720373    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-529k4"
Sep 20 00:47:35.726753 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.726735    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k4w8t"
Sep 20 00:47:35.733319 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.733299    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:35.739589 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.739566    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pv6x5"
Sep 20 00:47:35.745885 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.745864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h59fj"
Sep 20 00:47:35.750276 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:35.750257    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wxrgs"
Sep 20 00:47:36.019041 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.018981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:36.019041 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.019034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:36.019226 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.019123    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:36.019226 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.019186    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs podName:8a92ad3c-5004-4ec6-a9b0-30d474ee931e nodeName:}" failed. No retries permitted until 2026-09-20 00:47:37.019165114 +0000 UTC m=+4.012440639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs") pod "network-metrics-daemon-9brst" (UID: "8a92ad3c-5004-4ec6-a9b0-30d474ee931e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:36.019226 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.019123    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:36.019361 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.019243    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret podName:89d96c9f-5938-4fae-8377-4623f781d451 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:37.019232919 +0000 UTC m=+4.012508439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret") pod "global-pull-secret-syncer-p8hhh" (UID: "89d96c9f-5938-4fae-8377-4623f781d451") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:36.119747 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.119718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:36.119880 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.119835    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:36.119880 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.119851    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:36.119880 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.119859    2571 projected.go:196] Error preparing data for projected volume kube-api-access-n2nnx for pod openshift-network-diagnostics/network-check-target-w5xk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:36.120035 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.119903    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx podName:cb1186e9-9378-4dbe-bf23-bba1b4cf75c7 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:37.119887409 +0000 UTC m=+4.113162928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2nnx" (UniqueName: "kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx") pod "network-check-target-w5xk8" (UID: "cb1186e9-9378-4dbe-bf23-bba1b4cf75c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:36.227891 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:36.227868    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f225a2_931e_4088_b8d2_edbe0ca0406a.slice/crio-34c6af7afae834cf84b15b7e26e9f671ecedc10a691b032c54db8602fd22650d WatchSource:0}: Error finding container 34c6af7afae834cf84b15b7e26e9f671ecedc10a691b032c54db8602fd22650d: Status 404 returned error can't find the container with id 34c6af7afae834cf84b15b7e26e9f671ecedc10a691b032c54db8602fd22650d
Sep 20 00:47:36.229349 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:36.229303    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2c95f9_a162_46df_96e8_6397b7bcb58c.slice/crio-414ac4ba921b43e315ff3a933734f352dc7a24fcb7e19c7518148b20610efa60 WatchSource:0}: Error finding container 414ac4ba921b43e315ff3a933734f352dc7a24fcb7e19c7518148b20610efa60: Status 404 returned error can't find the container with id 414ac4ba921b43e315ff3a933734f352dc7a24fcb7e19c7518148b20610efa60
Sep 20 00:47:36.229924 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:36.229817    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d496d1_4515_4028_968d_bed88bddf477.slice/crio-6fb38f40acc462cd0a5c9cd589803f6501401e3742f18fafd1768dee75f5bcd4 WatchSource:0}: Error finding container 6fb38f40acc462cd0a5c9cd589803f6501401e3742f18fafd1768dee75f5bcd4: Status 404 returned error can't find the container with id 6fb38f40acc462cd0a5c9cd589803f6501401e3742f18fafd1768dee75f5bcd4
Sep 20 00:47:36.233434 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:36.233413    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5456db52_27f7_4aa9_b9ed_2a1dabac5e0b.slice/crio-90e51ab87d0d4a4c088b8c8846464022a5640fb5155a729d5bf9970e48ea8457 WatchSource:0}: Error finding container 90e51ab87d0d4a4c088b8c8846464022a5640fb5155a729d5bf9970e48ea8457: Status 404 returned error can't find the container with id 90e51ab87d0d4a4c088b8c8846464022a5640fb5155a729d5bf9970e48ea8457
Sep 20 00:47:36.234095 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:36.234077    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2015f96_1229_4720_9f8c_3ddb6a61bda4.slice/crio-384efb5639a23230c04bd6008600da46818507b05cf3c4007faf721b520542ec WatchSource:0}: Error finding container 384efb5639a23230c04bd6008600da46818507b05cf3c4007faf721b520542ec: Status 404 returned error can't find the container with id 384efb5639a23230c04bd6008600da46818507b05cf3c4007faf721b520542ec
Sep 20 00:47:36.235766 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:36.235740    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7adc32_efec_40b0_94e9_e8649ba5acff.slice/crio-4dcfe9420a9df7d6f704e711ba7a0d7871350cad95ce445f5684c0f472405275 WatchSource:0}: Error finding container 4dcfe9420a9df7d6f704e711ba7a0d7871350cad95ce445f5684c0f472405275: Status 404 returned error can't find the container with id 4dcfe9420a9df7d6f704e711ba7a0d7871350cad95ce445f5684c0f472405275
Sep 20 00:47:36.236223 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:47:36.236120    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77831236_c544_497a_89ad_d352f3a8b1ab.slice/crio-b24e69be1e649ed0fc3df5cf2f77a716fdd2a82b289a3e538b4673b447f92ee1 WatchSource:0}: Error finding container b24e69be1e649ed0fc3df5cf2f77a716fdd2a82b289a3e538b4673b447f92ee1: Status 404 returned error can't find the container with id b24e69be1e649ed0fc3df5cf2f77a716fdd2a82b289a3e538b4673b447f92ee1
Sep 20 00:47:36.441257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.441213    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 00:42:35 +0000 UTC" deadline="2028-06-17 22:27:39.158922584 +0000 UTC"
Sep 20 00:47:36.441257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.441256    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15285h40m2.717669693s"
Sep 20 00:47:36.502586 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.502439    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:36.502677 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.502473    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:36.502737 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.502670    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:36.502786 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:36.502760    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:36.509570 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.509546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerStarted","Data":"70968bba8337bc9a1e8a3dcf411b5aaba5c6056d274473bf65348cd57b1bbb3a"}
Sep 20 00:47:36.512774 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.512755    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg" event={"ID":"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b","Type":"ContainerStarted","Data":"90e51ab87d0d4a4c088b8c8846464022a5640fb5155a729d5bf9970e48ea8457"}
Sep 20 00:47:36.513947 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.513928    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wxrgs" event={"ID":"c4d496d1-4515-4028-968d-bed88bddf477","Type":"ContainerStarted","Data":"6fb38f40acc462cd0a5c9cd589803f6501401e3742f18fafd1768dee75f5bcd4"}
Sep 20 00:47:36.515780 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.515755    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal" event={"ID":"fa5c61b1f5e26b2389ad9ed376a58f2d","Type":"ContainerStarted","Data":"07390d3db085b6413a2d6be042b32c9f92a546e1d93e2a3ad4ebc6590acfb5f9"}
Sep 20 00:47:36.516913 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.516896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6js95" event={"ID":"0b7adc32-efec-40b0-94e9-e8649ba5acff","Type":"ContainerStarted","Data":"4dcfe9420a9df7d6f704e711ba7a0d7871350cad95ce445f5684c0f472405275"}
Sep 20 00:47:36.517902 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.517884    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-529k4" event={"ID":"9c2c95f9-a162-46df-96e8-6397b7bcb58c","Type":"ContainerStarted","Data":"414ac4ba921b43e315ff3a933734f352dc7a24fcb7e19c7518148b20610efa60"}
Sep 20 00:47:36.518914 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.518897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qd5c" event={"ID":"86f225a2-931e-4088-b8d2-edbe0ca0406a","Type":"ContainerStarted","Data":"34c6af7afae834cf84b15b7e26e9f671ecedc10a691b032c54db8602fd22650d"}
Sep 20 00:47:36.520284 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.520264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal" event={"ID":"c0b85168aed422541119cd2b668d6e09","Type":"ContainerStarted","Data":"a5aac00c59cc5b04d969eef60afaeee0acab924d5a030114d14a0347bde5091f"}
Sep 20 00:47:36.521227 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.521212    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pv6x5" event={"ID":"a2015f96-1229-4720-9f8c-3ddb6a61bda4","Type":"ContainerStarted","Data":"384efb5639a23230c04bd6008600da46818507b05cf3c4007faf721b520542ec"}
Sep 20 00:47:36.522307 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.522288    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k4w8t" event={"ID":"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9","Type":"ContainerStarted","Data":"b53fc371524bfbe524f66ac652989271400d5519f5a24815cba9aa10f7730394"}
Sep 20 00:47:36.523331 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.523314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"b24e69be1e649ed0fc3df5cf2f77a716fdd2a82b289a3e538b4673b447f92ee1"}
Sep 20 00:47:36.527626 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:36.527583    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-159.ec2.internal" podStartSLOduration=2.527574208 podStartE2EDuration="2.527574208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:36.527509609 +0000 UTC m=+3.520785148" watchObservedRunningTime="2026-09-20 00:47:36.527574208 +0000 UTC m=+3.520849736"
Sep 20 00:47:37.025498 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.024761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:37.025498 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.024821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:37.025498 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.024920    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:37.025498 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.024965    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret podName:89d96c9f-5938-4fae-8377-4623f781d451 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:39.024953892 +0000 UTC m=+6.018229401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret") pod "global-pull-secret-syncer-p8hhh" (UID: "89d96c9f-5938-4fae-8377-4623f781d451") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:37.025498 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.025377    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:37.025498 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.025423    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs podName:8a92ad3c-5004-4ec6-a9b0-30d474ee931e nodeName:}" failed. No retries permitted until 2026-09-20 00:47:39.025408025 +0000 UTC m=+6.018683536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs") pod "network-metrics-daemon-9brst" (UID: "8a92ad3c-5004-4ec6-a9b0-30d474ee931e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:37.126075 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.126017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:37.126272 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.126174    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:37.126272 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.126211    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:37.126272 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.126224    2571 projected.go:196] Error preparing data for projected volume kube-api-access-n2nnx for pod openshift-network-diagnostics/network-check-target-w5xk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:37.126272 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.126273    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx podName:cb1186e9-9378-4dbe-bf23-bba1b4cf75c7 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:39.126256583 +0000 UTC m=+6.119532096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2nnx" (UniqueName: "kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx") pod "network-check-target-w5xk8" (UID: "cb1186e9-9378-4dbe-bf23-bba1b4cf75c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:37.441779 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.441678    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 00:42:35 +0000 UTC" deadline="2028-04-25 12:45:18.41803289 +0000 UTC"
Sep 20 00:47:37.441779 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.441731    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14003h57m40.976305269s"
Sep 20 00:47:37.505492 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.505468    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:37.505631 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:37.505580    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:37.538811 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.538235    2571 generic.go:356] "Generic (PLEG): container finished" podID="c0b85168aed422541119cd2b668d6e09" containerID="a5aac00c59cc5b04d969eef60afaeee0acab924d5a030114d14a0347bde5091f" exitCode=0
Sep 20 00:47:37.538811 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.538739    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal" event={"ID":"c0b85168aed422541119cd2b668d6e09","Type":"ContainerDied","Data":"a5aac00c59cc5b04d969eef60afaeee0acab924d5a030114d14a0347bde5091f"}
Sep 20 00:47:37.538811 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.538777    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal" event={"ID":"c0b85168aed422541119cd2b668d6e09","Type":"ContainerStarted","Data":"2abb7c7945d29b6f10a05ce8b402ce698cf4f8a2fda43b12f876e4ca7337b5a7"}
Sep 20 00:47:37.554533 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:37.554491    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-159.ec2.internal" podStartSLOduration=3.5544777119999997 podStartE2EDuration="3.554477712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:37.554088613 +0000 UTC m=+4.547364144" watchObservedRunningTime="2026-09-20 00:47:37.554477712 +0000 UTC m=+4.547753242"
Sep 20 00:47:38.503555 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:38.503342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:38.503555 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:38.503469    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:38.504149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:38.503853    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:38.504149 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:38.503952    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:39.042257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:39.042222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:39.042469 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:39.042303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:39.042469 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.042392    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:39.042469 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.042411    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:39.042469 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.042461    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs podName:8a92ad3c-5004-4ec6-a9b0-30d474ee931e nodeName:}" failed. No retries permitted until 2026-09-20 00:47:43.042441096 +0000 UTC m=+10.035716621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs") pod "network-metrics-daemon-9brst" (UID: "8a92ad3c-5004-4ec6-a9b0-30d474ee931e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:39.042777 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.042480    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret podName:89d96c9f-5938-4fae-8377-4623f781d451 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:43.042470472 +0000 UTC m=+10.035745990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret") pod "global-pull-secret-syncer-p8hhh" (UID: "89d96c9f-5938-4fae-8377-4623f781d451") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:39.143810 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:39.143165    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:39.143810 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.143363    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:39.143810 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.143381    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:39.143810 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.143392    2571 projected.go:196] Error preparing data for projected volume kube-api-access-n2nnx for pod openshift-network-diagnostics/network-check-target-w5xk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:39.143810 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.143443    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx podName:cb1186e9-9378-4dbe-bf23-bba1b4cf75c7 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:43.143426529 +0000 UTC m=+10.136702053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2nnx" (UniqueName: "kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx") pod "network-check-target-w5xk8" (UID: "cb1186e9-9378-4dbe-bf23-bba1b4cf75c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:39.503485 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:39.503411    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:39.503648 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:39.503534    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:40.503271 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:40.502703    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:40.503271 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:40.502839    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:40.503271 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:40.502884    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:40.503271 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:40.503017    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:41.503151 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:41.503111    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:41.503642 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:41.503250    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:42.502650 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:42.502621    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:42.502837 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:42.502741    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:42.502996 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:42.502979    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:42.503102 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:42.503078    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:43.076499 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:43.076453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:43.076945 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:43.076514    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:43.076945 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.076615    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:43.076945 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.076674    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret podName:89d96c9f-5938-4fae-8377-4623f781d451 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:51.076655017 +0000 UTC m=+18.069930530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret") pod "global-pull-secret-syncer-p8hhh" (UID: "89d96c9f-5938-4fae-8377-4623f781d451") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:43.076945 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.076615    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:43.076945 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.076781    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs podName:8a92ad3c-5004-4ec6-a9b0-30d474ee931e nodeName:}" failed. No retries permitted until 2026-09-20 00:47:51.076757151 +0000 UTC m=+18.070032679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs") pod "network-metrics-daemon-9brst" (UID: "8a92ad3c-5004-4ec6-a9b0-30d474ee931e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:43.177265 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:43.177229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:43.177445 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.177418    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:43.177445 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.177441    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:43.177558 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.177454    2571 projected.go:196] Error preparing data for projected volume kube-api-access-n2nnx for pod openshift-network-diagnostics/network-check-target-w5xk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:43.177558 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.177518    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx podName:cb1186e9-9378-4dbe-bf23-bba1b4cf75c7 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:51.177499046 +0000 UTC m=+18.170774583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2nnx" (UniqueName: "kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx") pod "network-check-target-w5xk8" (UID: "cb1186e9-9378-4dbe-bf23-bba1b4cf75c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:43.504367 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:43.504287    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:43.504513 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:43.504397    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:44.502711 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:44.502640    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:44.503068 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:44.502755    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:44.503068 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:44.503032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:44.503139 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:44.503105    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:45.502760 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:45.502727    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:45.503126 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:45.502843    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:46.502437 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:46.502407    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:46.502549 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:46.502410    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:46.502549 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:46.502516    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:46.502657 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:46.502635    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:47.503126 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:47.503095    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:47.503598 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:47.503228    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:48.502866 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:48.502832    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:48.503046 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:48.502869    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:48.503046 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:48.502954    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:48.503125 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:48.503055    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:49.503170 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:49.503143    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:49.503600 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:49.503278    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:50.503242 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:50.503213    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:50.503717 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:50.503316    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:50.503717 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:50.503372    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:50.503717 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:50.503485    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:51.138640 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:51.138601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:51.138830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:51.138665    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:51.138830 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.138769    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:51.138830 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.138824    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret podName:89d96c9f-5938-4fae-8377-4623f781d451 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.138808638 +0000 UTC m=+34.132084149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret") pod "global-pull-secret-syncer-p8hhh" (UID: "89d96c9f-5938-4fae-8377-4623f781d451") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:51.138990 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.138769    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:51.138990 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.138937    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs podName:8a92ad3c-5004-4ec6-a9b0-30d474ee931e nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.138914603 +0000 UTC m=+34.132190128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs") pod "network-metrics-daemon-9brst" (UID: "8a92ad3c-5004-4ec6-a9b0-30d474ee931e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:51.239655 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:51.239625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:51.239801 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.239776    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:51.239801 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.239798    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:51.239874 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.239811    2571 projected.go:196] Error preparing data for projected volume kube-api-access-n2nnx for pod openshift-network-diagnostics/network-check-target-w5xk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:51.239874 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.239866    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx podName:cb1186e9-9378-4dbe-bf23-bba1b4cf75c7 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.23984922 +0000 UTC m=+34.233124734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2nnx" (UniqueName: "kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx") pod "network-check-target-w5xk8" (UID: "cb1186e9-9378-4dbe-bf23-bba1b4cf75c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:51.503211 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:51.503126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:51.503361 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:51.503268    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:52.502926 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:52.502886    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:52.503111 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:52.502901    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:52.503111 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:52.503009    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:52.503252 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:52.503128    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:53.504212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:53.504168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:53.504650 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:53.504293    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:54.503000 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.502694    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:54.503106 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.502694    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:54.503106 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:54.503068    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:54.503226 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:54.503179    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:54.580508 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.580485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-529k4" event={"ID":"9c2c95f9-a162-46df-96e8-6397b7bcb58c","Type":"ContainerStarted","Data":"38900b45ade596144ee5c734c7cd6041f9e915171db6a03ce499c984311d818b"}
Sep 20 00:47:54.582475 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.582454    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qd5c" event={"ID":"86f225a2-931e-4088-b8d2-edbe0ca0406a","Type":"ContainerStarted","Data":"f517c4e227ffa2ceb937d3de1010c156e775edbba46e87856061c0094b05a366"}
Sep 20 00:47:54.584447 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.584113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k4w8t" event={"ID":"b8e070d0-7f29-4f45-a2aa-c3f6e62823a9","Type":"ContainerStarted","Data":"482ea48672674f7b90f9f69f8c20fe880afa6db3e84a929f60be9cd71277e522"}
Sep 20 00:47:54.587636 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.587588    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"955e273c6175fc76141dde423b950e94239cd19be67b20e38bdc0bcc74ff6259"}
Sep 20 00:47:54.587755 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.587656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"0d65b6c711409b4f907c2c483c36f580981c35e8cad834aec46a30d76350e443"}
Sep 20 00:47:54.587755 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.587709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"6634906cf61d100c1f9885f208879aded056ec2b0ce5fd3407ef9ef86a5ab250"}
Sep 20 00:47:54.587855 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.587758    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"1f9d18f0aea5016ed419dd54412d86375b51427039bc75056b076bbdc9062545"}
Sep 20 00:47:54.587855 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.587803    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"499006d069b8e8b07740e85ec671f86778a312b910f27ac99ef94976477c938b"}
Sep 20 00:47:54.587855 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.587839    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"cb5a56e326b31df1826b8d6d2df9965f064fd546305c0715094d94ac47b0377a"}
Sep 20 00:47:54.589427 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.589403    2571 generic.go:356] "Generic (PLEG): container finished" podID="2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8" containerID="3f71faa231c33c4114e484352834809f3d0a75bd84a00a4f3436bd7d285e9e64" exitCode=0
Sep 20 00:47:54.589507 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.589486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerDied","Data":"3f71faa231c33c4114e484352834809f3d0a75bd84a00a4f3436bd7d285e9e64"}
Sep 20 00:47:54.591220 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.591185    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg" event={"ID":"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b","Type":"ContainerStarted","Data":"4c69bd940f158a44d178ecf604ec6429b2842009009749d58394642b91d1ec41"}
Sep 20 00:47:54.592850 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.592802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wxrgs" event={"ID":"c4d496d1-4515-4028-968d-bed88bddf477","Type":"ContainerStarted","Data":"48a37aa8796a14ae9d29299402eb10aabbb7c2fb2cbda145f51532e8e069056d"}
Sep 20 00:47:54.594612 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.594587    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6js95" event={"ID":"0b7adc32-efec-40b0-94e9-e8649ba5acff","Type":"ContainerStarted","Data":"c9c1f47c1e8aa28282468a201674bfc0220c1736520a6c4b39f5d44978989733"}
Sep 20 00:47:54.595087 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.595050    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-529k4" podStartSLOduration=3.873112568 podStartE2EDuration="21.595037346s" totalImagesPullingTime="17.721924778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:54.594540605 +0000 UTC m=+21.587816137" watchObservedRunningTime="2026-09-20 00:47:54.595037346 +0000 UTC m=+21.588312878"
Sep 20 00:47:54.609668 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.609627    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k4w8t" podStartSLOduration=3.860736536 podStartE2EDuration="21.609610469s" totalImagesPullingTime="17.748873933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:54.609612625 +0000 UTC m=+21.602888157" watchObservedRunningTime="2026-09-20 00:47:54.609610469 +0000 UTC m=+21.602886003"
Sep 20 00:47:54.644113 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.644075    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wxrgs" podStartSLOduration=3.920240066 podStartE2EDuration="21.644063469s" totalImagesPullingTime="17.723823403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:54.643488995 +0000 UTC m=+21.636764520" watchObservedRunningTime="2026-09-20 00:47:54.644063469 +0000 UTC m=+21.637339002"
Sep 20 00:47:54.658836 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.658803    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6qd5c" podStartSLOduration=3.9510482209999997 podStartE2EDuration="21.658792065s" totalImagesPullingTime="17.707743844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:54.658505591 +0000 UTC m=+21.651781124" watchObservedRunningTime="2026-09-20 00:47:54.658792065 +0000 UTC m=+21.652067598"
Sep 20 00:47:54.672312 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:54.672283    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6js95" podStartSLOduration=11.513095097 podStartE2EDuration="21.67227003s" totalImagesPullingTime="10.159174933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:54.672150604 +0000 UTC m=+21.665426136" watchObservedRunningTime="2026-09-20 00:47:54.67227003 +0000 UTC m=+21.665545563"
Sep 20 00:47:55.056087 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.056065    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 20 00:47:55.480300 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.480208    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-20T00:47:55.05608356Z","UUID":"1f3b978c-4c4e-4da3-a73e-181315e89d1e","Handler":null,"Name":"","Endpoint":""}
Sep 20 00:47:55.481927 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.481902    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 20 00:47:55.482037 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.481934    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 20 00:47:55.502764 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.502706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:55.502873 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:55.502820    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:55.598365 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.598331    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pv6x5" event={"ID":"a2015f96-1229-4720-9f8c-3ddb6a61bda4","Type":"ContainerStarted","Data":"2faba3be7a13503660ccdc387bf482f847dec082dfa35cd3a1fd2f8a6cfba8fb"}
Sep 20 00:47:55.600471 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.600444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg" event={"ID":"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b","Type":"ContainerStarted","Data":"cd8318233e5196a0911d6d8d4acc8aea403ed6398e36b866c43276c1a79c0e3f"}
Sep 20 00:47:55.613021 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:55.612979    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pv6x5" podStartSLOduration=4.894725644 podStartE2EDuration="22.612962957s" totalImagesPullingTime="17.718237313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:55.612603991 +0000 UTC m=+22.605879527" watchObservedRunningTime="2026-09-20 00:47:55.612962957 +0000 UTC m=+22.606238492"
Sep 20 00:47:56.502618 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:56.502594    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:56.502777 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:56.502594    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:56.502777 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:56.502714    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:56.502777 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:56.502765    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:56.607176 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:56.607140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg" event={"ID":"5456db52-27f7-4aa9-b9ed-2a1dabac5e0b","Type":"ContainerStarted","Data":"1592fd018e05de3cefc4d4755c907c96a70b5fb38d8754beab95730651e1375b"}
Sep 20 00:47:56.612066 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:56.612039    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"b91a5f10f854408c34b8079e75e5234e571b47745978e8b98f054bcf7a023d98"}
Sep 20 00:47:56.625416 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:56.625377    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q6scg" podStartSLOduration=3.964323849 podStartE2EDuration="23.625362913s" totalImagesPullingTime="19.661039064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:56.624666551 +0000 UTC m=+23.617942085" watchObservedRunningTime="2026-09-20 00:47:56.625362913 +0000 UTC m=+23.618638447"
Sep 20 00:47:57.502706 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:57.502678    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:57.502953 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:57.502829    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:57.861675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:57.861603    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:57.862387 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:57.862369    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:58.503439 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:58.503410    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:47:58.503615 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:58.503530    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:47:58.503615 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:58.503587    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:47:58.503723 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:58.503709    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:47:58.617255 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:58.617233    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:58.617693 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:58.617679    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6js95"
Sep 20 00:47:59.460081 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.459893    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:47:59.502958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.502934    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:47:59.503083 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:47:59.503062    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:47:59.548777 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.548744    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:47:59.622643 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.622621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" event={"ID":"77831236-c544-497a-89ad-d352f3a8b1ab","Type":"ContainerStarted","Data":"c50f88b39dd980a8dfe8127ae49af2aa962a08ee6dbf345835dcd604480104e0"}
Sep 20 00:47:59.622841 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.622824    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:59.624530 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.624506    2571 generic.go:356] "Generic (PLEG): container finished" podID="2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8" containerID="29c2908e05f550c2cc8ede70de7f3a9dadfd73068be3b65a67bf725647481e69" exitCode=0
Sep 20 00:47:59.624613 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.624569    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerDied","Data":"29c2908e05f550c2cc8ede70de7f3a9dadfd73068be3b65a67bf725647481e69"}
Sep 20 00:47:59.639294 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.639275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:47:59.653555 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:47:59.653517    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" podStartSLOduration=8.830230283 podStartE2EDuration="26.653506129s" totalImagesPullingTime="17.823275846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:59.651686209 +0000 UTC m=+26.644961743" watchObservedRunningTime="2026-09-20 00:47:59.653506129 +0000 UTC m=+26.646781661"
Sep 20 00:48:00.503054 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.502911    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:00.503368 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.502968    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:00.503368 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:00.503126    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:48:00.503368 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:00.503212    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:48:00.601947 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.601899    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p8hhh"]
Sep 20 00:48:00.605114 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.605083    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5xk8"]
Sep 20 00:48:00.605243 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.605181    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:00.605320 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:00.605286    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:48:00.605640 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.605616    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9brst"]
Sep 20 00:48:00.629839 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.629812    2571 generic.go:356] "Generic (PLEG): container finished" podID="2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8" containerID="d882bd45f323881c8aa520f600058e74f3cab32d21133a5392982e987ce7dcab" exitCode=0
Sep 20 00:48:00.629929 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.629900    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerDied","Data":"d882bd45f323881c8aa520f600058e74f3cab32d21133a5392982e987ce7dcab"}
Sep 20 00:48:00.629975 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.629965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:00.630067 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:00.630045    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:48:00.630166 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.630149    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 20 00:48:00.630602 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.630565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:00.631280 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:00.630691    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:48:00.631280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.630851    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:48:00.646882 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:00.646866    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:48:01.634683 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:01.634646    2571 generic.go:356] "Generic (PLEG): container finished" podID="2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8" containerID="95da44f65501863e008f7632eb5602e6b91b0657d78a381fb9faf919a7a6fb40" exitCode=0
Sep 20 00:48:01.635044 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:01.634731    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerDied","Data":"95da44f65501863e008f7632eb5602e6b91b0657d78a381fb9faf919a7a6fb40"}
Sep 20 00:48:01.635044 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:01.634871    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 20 00:48:02.502830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:02.502799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:02.502830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:02.502817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:02.502830 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:02.502828    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:02.503058 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:02.502920    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:48:02.503058 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:02.502973    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:48:02.503058 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:02.503048    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:48:02.637376 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:02.637348    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 20 00:48:03.474068 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:03.474029    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:48:03.484185 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:03.484152    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" podUID="77831236-c544-497a-89ad-d352f3a8b1ab" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 20 00:48:03.492146 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:03.492116    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" podUID="77831236-c544-497a-89ad-d352f3a8b1ab" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 20 00:48:03.651099 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:03.651068    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7" podUID="77831236-c544-497a-89ad-d352f3a8b1ab" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 20 00:48:04.443252 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:04.443219    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:04.502459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:04.502431    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:04.502459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:04.502460    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:04.502665 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:04.502460    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:04.502665 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:04.502553    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:48:04.502665 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:04.502641    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:48:04.502796 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:04.502717    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:48:04.502999 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:04.502967    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:04.562977 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:04.562913    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:04.618788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:04.618758    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:06.503178 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.503009    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:06.503594 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.503009    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:06.503594 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.503036    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:06.503594 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:06.503293    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8hhh" podUID="89d96c9f-5938-4fae-8377-4623f781d451"
Sep 20 00:48:06.503594 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:06.503383    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9brst" podUID="8a92ad3c-5004-4ec6-a9b0-30d474ee931e"
Sep 20 00:48:06.503594 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:06.503455    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5xk8" podUID="cb1186e9-9378-4dbe-bf23-bba1b4cf75c7"
Sep 20 00:48:06.649623 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.649563    2571 generic.go:356] "Generic (PLEG): container finished" podID="2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8" containerID="5a8003d337403174ae743080beba09bc990d8ceb59d48937f908311596cfb4be" exitCode=0
Sep 20 00:48:06.649623 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.649600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerDied","Data":"5a8003d337403174ae743080beba09bc990d8ceb59d48937f908311596cfb4be"}
Sep 20 00:48:06.773580 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.773550    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:06.848788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.848769    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-159.ec2.internal" event="NodeReady"
Sep 20 00:48:06.848895 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.848883    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 20 00:48:06.877034 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.877008    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:06.882381 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.882361    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bff5894cb-qfdx8"]
Sep 20 00:48:06.894048 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.894032    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rpbpb"]
Sep 20 00:48:06.894168 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.894152    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:06.896819 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.896802    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g8fk6\""
Sep 20 00:48:06.896890 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.896806    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 20 00:48:06.897085 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.897069    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 20 00:48:06.897152 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.897095    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 20 00:48:06.904609 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.904592    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 20 00:48:06.906092 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.906069    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6lzjv"]
Sep 20 00:48:06.906202 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.906171    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:06.908713 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.908694    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 20 00:48:06.908788 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.908755    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 20 00:48:06.909042 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.909028    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wd7tm\""
Sep 20 00:48:06.918187 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.918170    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bff5894cb-qfdx8"]
Sep 20 00:48:06.918304 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.918216    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rpbpb"]
Sep 20 00:48:06.918304 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.918236    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lzjv"]
Sep 20 00:48:06.918372 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.918314    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:06.920926 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.920902    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bsbfw\""
Sep 20 00:48:06.920998 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.920929    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 20 00:48:06.920998 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.920968    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 20 00:48:06.921077 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:06.921063    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 20 00:48:07.021536 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.021517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:07.072870 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.072849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.072940 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.072872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a749e23e-b6d5-4730-8064-7d0fbb4c5653-config-volume\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.072940 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.072890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-image-registry-private-configuration\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.072940 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.072908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a749e23e-b6d5-4730-8064-7d0fbb4c5653-tmp-dir\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.073053 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.072992    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c63d3f74-e958-431d-8377-2692418df143-ca-trust-extracted\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.073053 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-bound-sa-token\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.073053 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073032    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z72f\" (UniqueName: \"kubernetes.io/projected/a749e23e-b6d5-4730-8064-7d0fbb4c5653-kube-api-access-5z72f\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.073053 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073047    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-trusted-ca\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.073219 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e9e0af4-0cca-4bb1-9a43-887084c97435-cert\") pod \"ingress-canary-6lzjv\" (UID: \"5e9e0af4-0cca-4bb1-9a43-887084c97435\") " pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:07.073219 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7cb\" (UniqueName: \"kubernetes.io/projected/5e9e0af4-0cca-4bb1-9a43-887084c97435-kube-api-access-7k7cb\") pod \"ingress-canary-6lzjv\" (UID: \"5e9e0af4-0cca-4bb1-9a43-887084c97435\") " pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:07.073219 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-registry-certificates\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.073219 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-installation-pull-secrets\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.073219 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fd9j\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-kube-api-access-4fd9j\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.073387 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.073220    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.122104 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.122083    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:07.174054 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c63d3f74-e958-431d-8377-2692418df143-ca-trust-extracted\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.174054 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-bound-sa-token\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.174054 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z72f\" (UniqueName: \"kubernetes.io/projected/a749e23e-b6d5-4730-8064-7d0fbb4c5653-kube-api-access-5z72f\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.174257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-trusted-ca\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.174257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e9e0af4-0cca-4bb1-9a43-887084c97435-cert\") pod \"ingress-canary-6lzjv\" (UID: \"5e9e0af4-0cca-4bb1-9a43-887084c97435\") " pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:07.174257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7cb\" (UniqueName: \"kubernetes.io/projected/5e9e0af4-0cca-4bb1-9a43-887084c97435-kube-api-access-7k7cb\") pod \"ingress-canary-6lzjv\" (UID: \"5e9e0af4-0cca-4bb1-9a43-887084c97435\") " pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:07.174257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-registry-certificates\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.174257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-installation-pull-secrets\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.174257 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fd9j\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-kube-api-access-4fd9j\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.174564 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174224    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.174767 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.174838 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174797    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c63d3f74-e958-431d-8377-2692418df143-ca-trust-extracted\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.175099 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.175073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-registry-certificates\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.175185 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.175150    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:07.175185 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.175169    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bff5894cb-qfdx8: secret "image-registry-tls" not found
Sep 20 00:48:07.175309 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.175268    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:07.175356 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.175311    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls podName:c63d3f74-e958-431d-8377-2692418df143 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.675290216 +0000 UTC m=+34.668565743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls") pod "image-registry-7bff5894cb-qfdx8" (UID: "c63d3f74-e958-431d-8377-2692418df143") : secret "image-registry-tls" not found
Sep 20 00:48:07.175590 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.175417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a749e23e-b6d5-4730-8064-7d0fbb4c5653-config-volume\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.175682 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.175599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-trusted-ca\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.175682 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.175678    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls podName:a749e23e-b6d5-4730-8064-7d0fbb4c5653 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:07.675658669 +0000 UTC m=+34.668934182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls") pod "dns-default-rpbpb" (UID: "a749e23e-b6d5-4730-8064-7d0fbb4c5653") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:07.175861 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.174798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a749e23e-b6d5-4730-8064-7d0fbb4c5653-config-volume\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.175921 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.175900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-image-registry-private-configuration\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.176012 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.175995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a749e23e-b6d5-4730-8064-7d0fbb4c5653-tmp-dir\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.176068 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.176045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:07.176120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.176106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:07.176379 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.176361    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:48:07.176447 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.176423    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret podName:89d96c9f-5938-4fae-8377-4623f781d451 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:39.17640678 +0000 UTC m=+66.169682309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret") pod "global-pull-secret-syncer-p8hhh" (UID: "89d96c9f-5938-4fae-8377-4623f781d451") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:48:07.176721 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.176688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a749e23e-b6d5-4730-8064-7d0fbb4c5653-tmp-dir\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.177055 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.177040    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:48:07.177213 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.177111    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs podName:8a92ad3c-5004-4ec6-a9b0-30d474ee931e nodeName:}" failed. No retries permitted until 2026-09-20 00:48:39.177094256 +0000 UTC m=+66.170369782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs") pod "network-metrics-daemon-9brst" (UID: "8a92ad3c-5004-4ec6-a9b0-30d474ee931e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:48:07.180022 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.179996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-installation-pull-secrets\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.181068 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.181049    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e9e0af4-0cca-4bb1-9a43-887084c97435-cert\") pod \"ingress-canary-6lzjv\" (UID: \"5e9e0af4-0cca-4bb1-9a43-887084c97435\") " pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:07.181158 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.181141    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-image-registry-private-configuration\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.182442 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.182413    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fd9j\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-kube-api-access-4fd9j\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.182934 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.182908    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7cb\" (UniqueName: \"kubernetes.io/projected/5e9e0af4-0cca-4bb1-9a43-887084c97435-kube-api-access-7k7cb\") pod \"ingress-canary-6lzjv\" (UID: \"5e9e0af4-0cca-4bb1-9a43-887084c97435\") " pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:07.183572 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.183546    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z72f\" (UniqueName: \"kubernetes.io/projected/a749e23e-b6d5-4730-8064-7d0fbb4c5653-kube-api-access-5z72f\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.184013 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.183997    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-bound-sa-token\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.225370 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.225351    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lzjv"
Sep 20 00:48:07.276430 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.276406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:07.276563 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.276546    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:48:07.276607 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.276572    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:48:07.276607 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.276583    2571 projected.go:196] Error preparing data for projected volume kube-api-access-n2nnx for pod openshift-network-diagnostics/network-check-target-w5xk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:48:07.276683 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.276626    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx podName:cb1186e9-9378-4dbe-bf23-bba1b4cf75c7 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:39.2766139 +0000 UTC m=+66.269889411 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2nnx" (UniqueName: "kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx") pod "network-check-target-w5xk8" (UID: "cb1186e9-9378-4dbe-bf23-bba1b4cf75c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:48:07.543770 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.543732    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lzjv"]
Sep 20 00:48:07.546956 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:07.546932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9e0af4_0cca_4bb1_9a43_887084c97435.slice/crio-b4280834f9b4fef78d7b7a1a27d3ed5bbd81e505fa36376c8611165569546629 WatchSource:0}: Error finding container b4280834f9b4fef78d7b7a1a27d3ed5bbd81e505fa36376c8611165569546629: Status 404 returned error can't find the container with id b4280834f9b4fef78d7b7a1a27d3ed5bbd81e505fa36376c8611165569546629
Sep 20 00:48:07.654651 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.654625    2571 generic.go:356] "Generic (PLEG): container finished" podID="2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8" containerID="0ec9f328821c60e441d846f09b4d9a6b37d7649b02ceda4f5f75efcb9361ce2a" exitCode=0
Sep 20 00:48:07.654736 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.654703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerDied","Data":"0ec9f328821c60e441d846f09b4d9a6b37d7649b02ceda4f5f75efcb9361ce2a"}
Sep 20 00:48:07.655870 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.655851    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lzjv" event={"ID":"5e9e0af4-0cca-4bb1-9a43-887084c97435","Type":"ContainerStarted","Data":"b4280834f9b4fef78d7b7a1a27d3ed5bbd81e505fa36376c8611165569546629"}
Sep 20 00:48:07.680420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.679875    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:07.680420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.680064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:07.680579 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.680505    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:07.680579 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.680554    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls podName:a749e23e-b6d5-4730-8064-7d0fbb4c5653 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:08.680537277 +0000 UTC m=+35.673812798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls") pod "dns-default-rpbpb" (UID: "a749e23e-b6d5-4730-8064-7d0fbb4c5653") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:07.680686 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.680596    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:07.680686 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.680613    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bff5894cb-qfdx8: secret "image-registry-tls" not found
Sep 20 00:48:07.680686 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:07.680661    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls podName:c63d3f74-e958-431d-8377-2692418df143 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:08.68064819 +0000 UTC m=+35.673923700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls") pod "image-registry-7bff5894cb-qfdx8" (UID: "c63d3f74-e958-431d-8377-2692418df143") : secret "image-registry-tls" not found
Sep 20 00:48:07.836403 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.836313    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:07.892637 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:07.892614    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:08.502877 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.502850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:08.503045 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.502955    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:08.503045 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.503016    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:08.505880 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.505856    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 00:48:08.506616 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.506596    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 20 00:48:08.506729 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.506616    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkppn\""
Sep 20 00:48:08.507281 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.507146    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 20 00:48:08.507281 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.507166    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 00:48:08.507281 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.507241    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fnqwj\""
Sep 20 00:48:08.662312 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.662288    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h59fj" event={"ID":"2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8","Type":"ContainerStarted","Data":"d10ac6b8198c0d059fedc97a157a83ba31133af38d3012aa3d81010ec5dd3090"}
Sep 20 00:48:08.682067 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.682003    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h59fj" podStartSLOduration=7.908521573 podStartE2EDuration="35.681984134s" totalImagesPullingTime="27.773462561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:08.681714397 +0000 UTC m=+35.674989931" watchObservedRunningTime="2026-09-20 00:48:08.681984134 +0000 UTC m=+35.675259665"
Sep 20 00:48:08.687324 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.687100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:08.687324 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:08.687217    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:08.687324 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.687275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:08.687558 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:08.687335    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls podName:a749e23e-b6d5-4730-8064-7d0fbb4c5653 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:10.687318192 +0000 UTC m=+37.680593708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls") pod "dns-default-rpbpb" (UID: "a749e23e-b6d5-4730-8064-7d0fbb4c5653") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:08.687558 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:08.687377    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:08.687558 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:08.687393    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bff5894cb-qfdx8: secret "image-registry-tls" not found
Sep 20 00:48:08.687558 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:08.687430    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls podName:c63d3f74-e958-431d-8377-2692418df143 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:10.68741995 +0000 UTC m=+37.680695462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls") pod "image-registry-7bff5894cb-qfdx8" (UID: "c63d3f74-e958-431d-8377-2692418df143") : secret "image-registry-tls" not found
Sep 20 00:48:08.800556 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.800488    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:08.901874 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:08.901844    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:09.003223 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:09.003162    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:09.173041 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:09.172966    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:09.228537 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:09.228506    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:10.381778 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.381692    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:10.455664 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.455631    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:10.668927 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.668866    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lzjv" event={"ID":"5e9e0af4-0cca-4bb1-9a43-887084c97435","Type":"ContainerStarted","Data":"54b31d35482b48960c831fb76aabf1286b3c40df5e91fa703b1f7855ff7a88aa"}
Sep 20 00:48:10.685169 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.685121    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6lzjv" podStartSLOduration=2.235423823 podStartE2EDuration="4.685107265s" totalImagesPullingTime="2.449683442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:10.683806545 +0000 UTC m=+37.677082079" watchObservedRunningTime="2026-09-20 00:48:10.685107265 +0000 UTC m=+37.678382798"
Sep 20 00:48:10.702829 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.702792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:10.702939 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.702839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:10.702939 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:10.702878    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:10.702939 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:10.702921    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:10.702939 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:10.702932    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bff5894cb-qfdx8: secret "image-registry-tls" not found
Sep 20 00:48:10.703079 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:10.702942    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls podName:a749e23e-b6d5-4730-8064-7d0fbb4c5653 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:14.702925832 +0000 UTC m=+41.696201357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls") pod "dns-default-rpbpb" (UID: "a749e23e-b6d5-4730-8064-7d0fbb4c5653") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:10.703079 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:10.702966    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls podName:c63d3f74-e958-431d-8377-2692418df143 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:14.702955579 +0000 UTC m=+41.696231103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls") pod "image-registry-7bff5894cb-qfdx8" (UID: "c63d3f74-e958-431d-8377-2692418df143") : secret "image-registry-tls" not found
Sep 20 00:48:10.769046 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.769025    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:10.908144 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:10.908122    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.007746 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.007709    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.030597 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.030574    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9ffb8"]
Sep 20 00:48:11.063965 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.063946    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.067458 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.067441    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ffb8"]
Sep 20 00:48:11.067539 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.067529    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.069998 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.069974    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 20 00:48:11.070117 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.070096    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 20 00:48:11.070272 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.070258    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 20 00:48:11.070397 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.070379    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzh76\""
Sep 20 00:48:11.070516 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.070500    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 20 00:48:11.105001 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.104974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.105095 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.105010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nm4c\" (UniqueName: \"kubernetes.io/projected/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-api-access-7nm4c\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.105095 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.105038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-data-volume\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.105175 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.105100    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.105175 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.105140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-crio-socket\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.205919 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.205898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.206005 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.205925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nm4c\" (UniqueName: \"kubernetes.io/projected/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-api-access-7nm4c\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.206005 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.205953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-data-volume\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.206005 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.205980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.206005 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.206003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-crio-socket\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.206234 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.206070    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.206234 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.206082    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:11.206234 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.206129    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:11.706112945 +0000 UTC m=+38.699388473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.206234 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.206145    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:11.706137357 +0000 UTC m=+38.699412868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:11.206441 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.206317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-crio-socket\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.206441 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.206369    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-data-volume\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.215396 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.215374    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nm4c\" (UniqueName: \"kubernetes.io/projected/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-api-access-7nm4c\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.341007 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.340924    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.365775 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.365754    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"]
Sep 20 00:48:11.392219 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.392183    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"]
Sep 20 00:48:11.392492 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.392268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"
Sep 20 00:48:11.394668 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.394651    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 20 00:48:11.394668 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.394656    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z4qmx\""
Sep 20 00:48:11.394840 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.394826    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 20 00:48:11.406849 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.406829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcwvq\" (UniqueName: \"kubernetes.io/projected/cf4845f5-4024-4c1b-93e7-97e6417cbf8f-kube-api-access-hcwvq\") pod \"migrator-76794cbd6c-6rdvd\" (UID: \"cf4845f5-4024-4c1b-93e7-97e6417cbf8f\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"
Sep 20 00:48:11.410008 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.409987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.465042 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.465013    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.508204 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.508171    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcwvq\" (UniqueName: \"kubernetes.io/projected/cf4845f5-4024-4c1b-93e7-97e6417cbf8f-kube-api-access-hcwvq\") pod \"migrator-76794cbd6c-6rdvd\" (UID: \"cf4845f5-4024-4c1b-93e7-97e6417cbf8f\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"
Sep 20 00:48:11.516417 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.516211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcwvq\" (UniqueName: \"kubernetes.io/projected/cf4845f5-4024-4c1b-93e7-97e6417cbf8f-kube-api-access-hcwvq\") pod \"migrator-76794cbd6c-6rdvd\" (UID: \"cf4845f5-4024-4c1b-93e7-97e6417cbf8f\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"
Sep 20 00:48:11.609324 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.609242    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.669288 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.669256    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:11.700329 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.700303    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"
Sep 20 00:48:11.709743 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.709720    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.709846 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.709762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:11.709846 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.709837    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:11.709916 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.709877    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.709948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.709884    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:12.709870018 +0000 UTC m=+39.703145529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:11.710035 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:11.710018    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:12.709995874 +0000 UTC m=+39.703271387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:11.986420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:11.986349    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd"]
Sep 20 00:48:11.990497 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:11.990472    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4845f5_4024_4c1b_93e7_97e6417cbf8f.slice/crio-b54aa1284e638a382a73a99d8fdf71066a592913ad006d18ca5d650d5657475e WatchSource:0}: Error finding container b54aa1284e638a382a73a99d8fdf71066a592913ad006d18ca5d650d5657475e: Status 404 returned error can't find the container with id b54aa1284e638a382a73a99d8fdf71066a592913ad006d18ca5d650d5657475e
Sep 20 00:48:12.400950 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:12.400923    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-529k4_9c2c95f9-a162-46df-96e8-6397b7bcb58c/dns-node-resolver/0.log"
Sep 20 00:48:12.674449 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:12.674382    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd" event={"ID":"cf4845f5-4024-4c1b-93e7-97e6417cbf8f","Type":"ContainerStarted","Data":"b54aa1284e638a382a73a99d8fdf71066a592913ad006d18ca5d650d5657475e"}
Sep 20 00:48:12.717360 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:12.717335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:12.717475 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:12.717392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:12.717543 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:12.717484    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:12.717543 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:12.717504    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:12.717543 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:12.717540    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:14.717521536 +0000 UTC m=+41.710797050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:12.717658 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:12.717565    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:14.717547202 +0000 UTC m=+41.710822732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:13.047688 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.047655    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:13.097539 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.097488    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:13.208963 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.208934    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-fqfll"]
Sep 20 00:48:13.221827 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.221803    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-fqfll"]
Sep 20 00:48:13.221960 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.221911    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.224568 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.224547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 20 00:48:13.224701 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.224568    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 20 00:48:13.225528 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.225514    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 20 00:48:13.225528 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.225519    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nx77q\""
Sep 20 00:48:13.225657 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.225518    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 20 00:48:13.239981 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.239958    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:13.322405 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.322359    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0aeced36-a7bd-4f1f-8a77-84dfd554658b-signing-cabundle\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.322405 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.322385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5x4\" (UniqueName: \"kubernetes.io/projected/0aeced36-a7bd-4f1f-8a77-84dfd554658b-kube-api-access-hm5x4\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.322531 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.322450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0aeced36-a7bd-4f1f-8a77-84dfd554658b-signing-key\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.423287 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.423267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0aeced36-a7bd-4f1f-8a77-84dfd554658b-signing-key\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.423755 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.423334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0aeced36-a7bd-4f1f-8a77-84dfd554658b-signing-cabundle\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.423755 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.423358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5x4\" (UniqueName: \"kubernetes.io/projected/0aeced36-a7bd-4f1f-8a77-84dfd554658b-kube-api-access-hm5x4\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.424049 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.424032    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0aeced36-a7bd-4f1f-8a77-84dfd554658b-signing-cabundle\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.425965 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.425941    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0aeced36-a7bd-4f1f-8a77-84dfd554658b-signing-key\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.431455 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.431434    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5x4\" (UniqueName: \"kubernetes.io/projected/0aeced36-a7bd-4f1f-8a77-84dfd554658b-kube-api-access-hm5x4\") pod \"service-ca-55f6fc7b86-fqfll\" (UID: \"0aeced36-a7bd-4f1f-8a77-84dfd554658b\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.530964 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.530944    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll"
Sep 20 00:48:13.600725 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.600678    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qd5c_86f225a2-931e-4088-b8d2-edbe0ca0406a/node-ca/0.log"
Sep 20 00:48:13.918973 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:13.918947    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-fqfll"]
Sep 20 00:48:13.922986 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:13.922956    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aeced36_a7bd_4f1f_8a77_84dfd554658b.slice/crio-457811b6dfacf450964f0c1e75b9e496182245326562a40f808d200ff9254651 WatchSource:0}: Error finding container 457811b6dfacf450964f0c1e75b9e496182245326562a40f808d200ff9254651: Status 404 returned error can't find the container with id 457811b6dfacf450964f0c1e75b9e496182245326562a40f808d200ff9254651
Sep 20 00:48:14.201209 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.201135    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lzjv_5e9e0af4-0cca-4bb1-9a43-887084c97435/serve-healthcheck-canary/0.log"
Sep 20 00:48:14.305202 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.305156    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:14.681067 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.681031    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd" event={"ID":"cf4845f5-4024-4c1b-93e7-97e6417cbf8f","Type":"ContainerStarted","Data":"95b302cd6c172a2e2c7e4ab495f7b136b48c7dff9a53e77e8224cf6e80dffb6f"}
Sep 20 00:48:14.681537 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.681135    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd" event={"ID":"cf4845f5-4024-4c1b-93e7-97e6417cbf8f","Type":"ContainerStarted","Data":"61d4c63da2af2f18527e995ab2cf2654fbf8a524ee14f8885cb3f5d17e9bac1c"}
Sep 20 00:48:14.682300 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.682272    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll" event={"ID":"0aeced36-a7bd-4f1f-8a77-84dfd554658b","Type":"ContainerStarted","Data":"457811b6dfacf450964f0c1e75b9e496182245326562a40f808d200ff9254651"}
Sep 20 00:48:14.698111 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.698064    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rdvd" podStartSLOduration=2.034455532 podStartE2EDuration="3.69805174s" totalImagesPullingTime="1.663596208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:14.697549283 +0000 UTC m=+41.690824822" watchObservedRunningTime="2026-09-20 00:48:14.69805174 +0000 UTC m=+41.691327273"
Sep 20 00:48:14.733618 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.733580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:14.733754 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.733621    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:14.733754 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.733659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:14.733754 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.733689    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:14.733754 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733729    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733796    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls podName:a749e23e-b6d5-4730-8064-7d0fbb4c5653 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:22.733779408 +0000 UTC m=+49.727054932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls") pod "dns-default-rpbpb" (UID: "a749e23e-b6d5-4730-8064-7d0fbb4c5653") : secret "dns-default-metrics-tls" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733799    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733822    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733859    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:18.73384713 +0000 UTC m=+45.727122657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : configmap "kube-rbac-proxy" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733875    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:18.733867276 +0000 UTC m=+45.727142793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733855    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733890    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bff5894cb-qfdx8: secret "image-registry-tls" not found
Sep 20 00:48:14.733948 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:14.733920    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls podName:c63d3f74-e958-431d-8377-2692418df143 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:22.733911677 +0000 UTC m=+49.727187190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls") pod "image-registry-7bff5894cb-qfdx8" (UID: "c63d3f74-e958-431d-8377-2692418df143") : secret "image-registry-tls" not found
Sep 20 00:48:14.798039 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.798004    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:14.868817 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:14.868775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:15.999352 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:15.999312    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:16.688544 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:16.688507    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll" event={"ID":"0aeced36-a7bd-4f1f-8a77-84dfd554658b","Type":"ContainerStarted","Data":"4aedb49cde3c1d408af27276755ee1d43c53c49681846a3cca9faa969d61bc70"}
Sep 20 00:48:16.707327 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:16.707274    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-fqfll" podStartSLOduration=1.519351804 podStartE2EDuration="3.707255436s" totalImagesPullingTime="2.187903632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:16.706672139 +0000 UTC m=+43.699947672" watchObservedRunningTime="2026-09-20 00:48:16.707255436 +0000 UTC m=+43.700530970"
Sep 20 00:48:17.178759 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:17.178730    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:17.800666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:17.800618    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:17.962324 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:17.962273    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:18.061919 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:18.061850    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:18.162759 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:18.162726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:18.220066 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:18.220042    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:18.494885 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:18.494810    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:18.766680 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:18.766653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:18.766806 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:18.766704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:18.766806 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:18.766791    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:18.766913 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:18.766845    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls podName:9e785c7e-4e24-40e5-ad0a-f7fee4a90e57 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:26.766832273 +0000 UTC m=+53.760107784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ffb8" (UID: "9e785c7e-4e24-40e5-ad0a-f7fee4a90e57") : secret "insights-runtime-extractor-tls" not found
Sep 20 00:48:18.767220 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:18.767182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:19.490049 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:19.490017    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:19.895217 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:19.895175    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:20.091322 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:20.091295    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:20.297135 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:20.297112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:20.492905 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:20.492881    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:20.593340 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:20.593282    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:21.085370 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:21.085332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:21.461058 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:21.460975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:21.512081 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:21.512052    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:21.692348 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:21.692324    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:21.887832 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:21.887802    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:22.294123 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.294098    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:22.346380 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.346354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:22.793524 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.793482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:22.793920 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.793542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:22.795949 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.795923    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a749e23e-b6d5-4730-8064-7d0fbb4c5653-metrics-tls\") pod \"dns-default-rpbpb\" (UID: \"a749e23e-b6d5-4730-8064-7d0fbb4c5653\") " pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:22.796054 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.795969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"image-registry-7bff5894cb-qfdx8\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") " pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:22.803856 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.803835    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:22.814469 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.814450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:22.896900 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:22.896874    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:23.096584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.096513    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bff5894cb-qfdx8"]
Sep 20 00:48:23.099898 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:23.099869    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63d3f74_e958_431d_8377_2692418df143.slice/crio-fcc042077d3b3c32fcee34831fd3af948d553ddaa8e8417b00782710b4729679 WatchSource:0}: Error finding container fcc042077d3b3c32fcee34831fd3af948d553ddaa8e8417b00782710b4729679: Status 404 returned error can't find the container with id fcc042077d3b3c32fcee34831fd3af948d553ddaa8e8417b00782710b4729679
Sep 20 00:48:23.115129 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.115106    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rpbpb"]
Sep 20 00:48:23.117909 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:23.117887    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda749e23e_b6d5_4730_8064_7d0fbb4c5653.slice/crio-688f603f48d14b836549b012b9689f9e0ba01310f4a84d88f5bd8754d424b6a5 WatchSource:0}: Error finding container 688f603f48d14b836549b012b9689f9e0ba01310f4a84d88f5bd8754d424b6a5: Status 404 returned error can't find the container with id 688f603f48d14b836549b012b9689f9e0ba01310f4a84d88f5bd8754d424b6a5
Sep 20 00:48:23.293134 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.293092    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:23.489493 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.489417    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:23.602011 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.601977    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:23.703645 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.703609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:23.706676 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.706645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpbpb" event={"ID":"a749e23e-b6d5-4730-8064-7d0fbb4c5653","Type":"ContainerStarted","Data":"688f603f48d14b836549b012b9689f9e0ba01310f4a84d88f5bd8754d424b6a5"}
Sep 20 00:48:23.708490 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.708465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8" event={"ID":"c63d3f74-e958-431d-8377-2692418df143","Type":"ContainerStarted","Data":"47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9"}
Sep 20 00:48:23.708624 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.708511    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8" event={"ID":"c63d3f74-e958-431d-8377-2692418df143","Type":"ContainerStarted","Data":"fcc042077d3b3c32fcee34831fd3af948d553ddaa8e8417b00782710b4729679"}
Sep 20 00:48:23.708681 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.708628    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:23.728099 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.727757    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8" podStartSLOduration=30.727738559 podStartE2EDuration="30.727738559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:23.727685567 +0000 UTC m=+50.720961101" watchObservedRunningTime="2026-09-20 00:48:23.727738559 +0000 UTC m=+50.721014089"
Sep 20 00:48:23.892461 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:23.892423    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:24.497274 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:24.497222    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:24.673858 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:24.673812    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:24.896346 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:24.896317    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:25.093234 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:25.093113    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:25.497019 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:25.496992    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:25.717744 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:25.717713    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpbpb" event={"ID":"a749e23e-b6d5-4730-8064-7d0fbb4c5653","Type":"ContainerStarted","Data":"24ce015768f1ae0549223ea2965ca3d7b9a0d8dcb30ff0e2d856efef8de69851"}
Sep 20 00:48:25.717961 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:25.717760    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpbpb" event={"ID":"a749e23e-b6d5-4730-8064-7d0fbb4c5653","Type":"ContainerStarted","Data":"2070e008c1b26845b010986a13c5e41c643072b5578a6db6ed53b6240ac0f8f4"}
Sep 20 00:48:25.717961 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:25.717864    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:25.734163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:25.734116    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rpbpb" podStartSLOduration=18.099931921 podStartE2EDuration="19.734098281s" totalImagesPullingTime="1.63416636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:25.733764852 +0000 UTC m=+52.727040385" watchObservedRunningTime="2026-09-20 00:48:25.734098281 +0000 UTC m=+52.727373814"
Sep 20 00:48:26.095947 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:26.095858    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:26.492572 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:26.492476    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:26.821349 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:26.821290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:26.823604 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:26.823576    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e785c7e-4e24-40e5-ad0a-f7fee4a90e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ffb8\" (UID: \"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57\") " pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:26.895056 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:26.895025    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:26.976843 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:26.976808    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ffb8"
Sep 20 00:48:27.102506 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:27.102387    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:27.249619 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:27.247645    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ffb8"]
Sep 20 00:48:27.253151 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:27.253126    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e785c7e_4e24_40e5_ad0a_f7fee4a90e57.slice/crio-2f050ce4c64f2ab018d8347dae632a75f962c44034460894cec9537eee4e0be4 WatchSource:0}: Error finding container 2f050ce4c64f2ab018d8347dae632a75f962c44034460894cec9537eee4e0be4: Status 404 returned error can't find the container with id 2f050ce4c64f2ab018d8347dae632a75f962c44034460894cec9537eee4e0be4
Sep 20 00:48:27.489436 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:27.489342    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:27.725966 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:27.725933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ffb8" event={"ID":"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57","Type":"ContainerStarted","Data":"795bbb59c3a4c5c99cf44517cc18623460759b7849d0d69920a5fa746693ee61"}
Sep 20 00:48:27.726238 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:27.725995    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ffb8" event={"ID":"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57","Type":"ContainerStarted","Data":"2f050ce4c64f2ab018d8347dae632a75f962c44034460894cec9537eee4e0be4"}
Sep 20 00:48:27.893328 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:27.893303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:28.290816 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:28.290776    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:28.492690 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:28.492652    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:28.730892 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:28.730817    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ffb8" event={"ID":"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57","Type":"ContainerStarted","Data":"4d7b49420f8c856edf893f6a360b60e49f9a16e9478a715b22ec12657ea9c714"}
Sep 20 00:48:29.737419 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:29.737380    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ffb8" event={"ID":"9e785c7e-4e24-40e5-ad0a-f7fee4a90e57","Type":"ContainerStarted","Data":"bc5379d8261024dbcf795943eca92eff50156ffacceab8569d536d3b2abf7592"}
Sep 20 00:48:29.756415 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:29.756363    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9ffb8" podStartSLOduration=17.01796655 podStartE2EDuration="18.756345975s" totalImagesPullingTime="1.738379425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:48:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:29.75457992 +0000 UTC m=+56.747855455" watchObservedRunningTime="2026-09-20 00:48:29.756345975 +0000 UTC m=+56.749621505"
Sep 20 00:48:29.795763 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:29.795729    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:29.852731 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:29.852692    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:32.210441 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.210407    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"]
Sep 20 00:48:32.212792 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.212771    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.216391 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.216355    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 20 00:48:32.216391 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.216355    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-drnxr\""
Sep 20 00:48:32.216559 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.216394    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 20 00:48:32.225031 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.225001    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bff5894cb-qfdx8"]
Sep 20 00:48:32.225931 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.225910    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"]
Sep 20 00:48:32.263376 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.263342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/551414d2-f883-4128-97e0-ef44f7f686d5-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-ngqzr\" (UID: \"551414d2-f883-4128-97e0-ef44f7f686d5\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.263545 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.263420    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/551414d2-f883-4128-97e0-ef44f7f686d5-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-ngqzr\" (UID: \"551414d2-f883-4128-97e0-ef44f7f686d5\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.337177 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.337140    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64fbdbc8d8-lsztg"]
Sep 20 00:48:32.339018 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.339002    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.354554 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.354523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:32.364452 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.364424    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64fbdbc8d8-lsztg"]
Sep 20 00:48:32.364565 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.364468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/551414d2-f883-4128-97e0-ef44f7f686d5-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-ngqzr\" (UID: \"551414d2-f883-4128-97e0-ef44f7f686d5\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.364565 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.364552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/551414d2-f883-4128-97e0-ef44f7f686d5-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-ngqzr\" (UID: \"551414d2-f883-4128-97e0-ef44f7f686d5\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.365051 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.365037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/551414d2-f883-4128-97e0-ef44f7f686d5-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-ngqzr\" (UID: \"551414d2-f883-4128-97e0-ef44f7f686d5\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.367144 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.367124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/551414d2-f883-4128-97e0-ef44f7f686d5-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-ngqzr\" (UID: \"551414d2-f883-4128-97e0-ef44f7f686d5\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.448489 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.448448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:32.465036 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.464975    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-registry-tls\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.465036 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.465004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-bound-sa-token\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.465036 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.465029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld6xl\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-kube-api-access-ld6xl\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.465249 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.465076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-ca-trust-extracted\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.465249 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.465129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-installation-pull-secrets\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.465249 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.465208    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-registry-certificates\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.465249 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.465243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-trusted-ca\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.465387 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.465271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-image-registry-private-configuration\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.526219 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.526168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"
Sep 20 00:48:32.540969 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.540939    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:32.565906 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.565869    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-registry-tls\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.565906 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.565901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-bound-sa-token\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.566142 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.566035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld6xl\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-kube-api-access-ld6xl\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.566142 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.566087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-ca-trust-extracted\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.566275 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.566156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-installation-pull-secrets\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.566275 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.566220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-registry-certificates\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.566275 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.566248    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-trusted-ca\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.566447 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.566301    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-image-registry-private-configuration\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.566568 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.566542    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-ca-trust-extracted\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.567139 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.567111    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-registry-certificates\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.567330 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.567313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-trusted-ca\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.568470 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.568443    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-registry-tls\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.568856 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.568835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-installation-pull-secrets\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.569038 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.569009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-image-registry-private-configuration\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.577659 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.577523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-bound-sa-token\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.580145 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.580118    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld6xl\" (UniqueName: \"kubernetes.io/projected/51ae6a87-aa24-47cb-ae1d-6ac6ac90b449-kube-api-access-ld6xl\") pod \"image-registry-64fbdbc8d8-lsztg\" (UID: \"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449\") " pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.640983 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.640948    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:32.647934 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.647910    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:32.795370 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.795339    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr"]
Sep 20 00:48:32.798441 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:32.798418    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551414d2_f883_4128_97e0_ef44f7f686d5.slice/crio-0c871b42103219fcdc3e811f52137ececce9956b7ee4bcadea0ca0901d394866 WatchSource:0}: Error finding container 0c871b42103219fcdc3e811f52137ececce9956b7ee4bcadea0ca0901d394866: Status 404 returned error can't find the container with id 0c871b42103219fcdc3e811f52137ececce9956b7ee4bcadea0ca0901d394866
Sep 20 00:48:32.918307 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:32.918260    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64fbdbc8d8-lsztg"]
Sep 20 00:48:32.920837 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:32.920808    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ae6a87_aa24_47cb_ae1d_6ac6ac90b449.slice/crio-6b06ef05fb1661eb12f331b20bba46bd07e106625ee6ab44c3fc4f9e530ce660 WatchSource:0}: Error finding container 6b06ef05fb1661eb12f331b20bba46bd07e106625ee6ab44c3fc4f9e530ce660: Status 404 returned error can't find the container with id 6b06ef05fb1661eb12f331b20bba46bd07e106625ee6ab44c3fc4f9e530ce660
Sep 20 00:48:33.018426 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.018357    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.022962 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.022940    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-5wsjj"]
Sep 20 00:48:33.024777 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.024762    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-5wsjj"
Sep 20 00:48:33.027280 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.027257    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lthkr\""
Sep 20 00:48:33.027450 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.027423    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 20 00:48:33.027564 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.027487    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 20 00:48:33.036363 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.036337    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-5wsjj"]
Sep 20 00:48:33.071421 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.071335    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6hmx\" (UniqueName: \"kubernetes.io/projected/87ba91cf-c2b1-49c4-b702-33db98397608-kube-api-access-n6hmx\") pod \"downloads-6594f4c75-5wsjj\" (UID: \"87ba91cf-c2b1-49c4-b702-33db98397608\") " pod="openshift-console/downloads-6594f4c75-5wsjj"
Sep 20 00:48:33.117774 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.117738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.172132 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.172091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6hmx\" (UniqueName: \"kubernetes.io/projected/87ba91cf-c2b1-49c4-b702-33db98397608-kube-api-access-n6hmx\") pod \"downloads-6594f4c75-5wsjj\" (UID: \"87ba91cf-c2b1-49c4-b702-33db98397608\") " pod="openshift-console/downloads-6594f4c75-5wsjj"
Sep 20 00:48:33.180265 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.180237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6hmx\" (UniqueName: \"kubernetes.io/projected/87ba91cf-c2b1-49c4-b702-33db98397608-kube-api-access-n6hmx\") pod \"downloads-6594f4c75-5wsjj\" (UID: \"87ba91cf-c2b1-49c4-b702-33db98397608\") " pod="openshift-console/downloads-6594f4c75-5wsjj"
Sep 20 00:48:33.183968 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.183944    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.305071 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.305032    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.334432 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.334346    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-5wsjj"
Sep 20 00:48:33.517444 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.517406    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.571602 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.571569    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.613592 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.613509    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-5wsjj"]
Sep 20 00:48:33.649643 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.649616    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzbh7"
Sep 20 00:48:33.677264 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.677230    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.734942 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:33.734914    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ba91cf_c2b1_49c4_b702_33db98397608.slice/crio-5accd101e7a81d456b7e759552067a3ac9de205458b57844f694be7e78eb10a9 WatchSource:0}: Error finding container 5accd101e7a81d456b7e759552067a3ac9de205458b57844f694be7e78eb10a9: Status 404 returned error can't find the container with id 5accd101e7a81d456b7e759552067a3ac9de205458b57844f694be7e78eb10a9
Sep 20 00:48:33.751677 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.751643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr" event={"ID":"551414d2-f883-4128-97e0-ef44f7f686d5","Type":"ContainerStarted","Data":"0c871b42103219fcdc3e811f52137ececce9956b7ee4bcadea0ca0901d394866"}
Sep 20 00:48:33.752926 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.752898    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-5wsjj" event={"ID":"87ba91cf-c2b1-49c4-b702-33db98397608","Type":"ContainerStarted","Data":"5accd101e7a81d456b7e759552067a3ac9de205458b57844f694be7e78eb10a9"}
Sep 20 00:48:33.754423 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.754398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg" event={"ID":"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449","Type":"ContainerStarted","Data":"da2e1acc304f175f28943d1bf4d873d5ad80edd5282d7d992261397ae3fca625"}
Sep 20 00:48:33.754507 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.754433    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg" event={"ID":"51ae6a87-aa24-47cb-ae1d-6ac6ac90b449","Type":"ContainerStarted","Data":"6b06ef05fb1661eb12f331b20bba46bd07e106625ee6ab44c3fc4f9e530ce660"}
Sep 20 00:48:33.754645 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.754623    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:33.773052 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.773005    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg" podStartSLOduration=1.772988424 podStartE2EDuration="1.772988424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:33.771530273 +0000 UTC m=+60.764805808" watchObservedRunningTime="2026-09-20 00:48:33.772988424 +0000 UTC m=+60.766263957"
Sep 20 00:48:33.774576 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.774545    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.874930 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.874844    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:33.931802 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:33.931769    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:34.097102 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.097072    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:34.197978 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.197889    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:34.324541 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.324507    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:34.376262 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.376227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:34.694548 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.694440    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:34.759752 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.759715    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr" event={"ID":"551414d2-f883-4128-97e0-ef44f7f686d5","Type":"ContainerStarted","Data":"509c369fe6802bfbba1e230801044985e6ac1cec88ad7f70f621af46784d94f4"}
Sep 20 00:48:34.773920 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.773855    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ngqzr" podStartSLOduration=1.819567353 podStartE2EDuration="2.773835333s" totalImagesPullingTime="954.26798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:34.773747631 +0000 UTC m=+61.767023165" watchObservedRunningTime="2026-09-20 00:48:34.773835333 +0000 UTC m=+61.767110848"
Sep 20 00:48:34.778183 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.778152    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:34.901054 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:34.901019    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:35.001308 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:35.001271    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:35.723849 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:35.723818    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rpbpb"
Sep 20 00:48:36.320531 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:36.320487    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:36.997621 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:36.997577    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:37.098623 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:37.098572    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:37.163007 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:37.162975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:37.580457 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:37.580411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:37.680358 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:37.680323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:37.948758 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:37.948663    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:39.225171 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.225129    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:39.225659 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.225187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:39.228161 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.228140    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 00:48:39.228296 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.228150    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 00:48:39.237966 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.237935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a92ad3c-5004-4ec6-a9b0-30d474ee931e-metrics-certs\") pod \"network-metrics-daemon-9brst\" (UID: \"8a92ad3c-5004-4ec6-a9b0-30d474ee931e\") " pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:39.238081 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.238022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89d96c9f-5938-4fae-8377-4623f781d451-original-pull-secret\") pod \"global-pull-secret-syncer-p8hhh\" (UID: \"89d96c9f-5938-4fae-8377-4623f781d451\") " pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:39.326527 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.326485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:39.329430 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.329408    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 20 00:48:39.339557 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.339530    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 20 00:48:39.350445 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.350411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2nnx\" (UniqueName: \"kubernetes.io/projected/cb1186e9-9378-4dbe-bf23-bba1b4cf75c7-kube-api-access-n2nnx\") pod \"network-check-target-w5xk8\" (UID: \"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7\") " pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:39.416519 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.416487    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fnqwj\""
Sep 20 00:48:39.423869 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.423842    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkppn\""
Sep 20 00:48:39.424047 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.424035    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:39.426897 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.426871    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8hhh"
Sep 20 00:48:39.432620 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.432599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9brst"
Sep 20 00:48:39.737504 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.737477    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p8hhh"]
Sep 20 00:48:39.740341 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:39.740315    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d96c9f_5938_4fae_8377_4623f781d451.slice/crio-777c5aec79e84756df7ed1ae4a43ad7a94eaf5242e9be7ced015804ae36da1ee WatchSource:0}: Error finding container 777c5aec79e84756df7ed1ae4a43ad7a94eaf5242e9be7ced015804ae36da1ee: Status 404 returned error can't find the container with id 777c5aec79e84756df7ed1ae4a43ad7a94eaf5242e9be7ced015804ae36da1ee
Sep 20 00:48:39.745986 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.745936    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5xk8"]
Sep 20 00:48:39.747357 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.747303    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9brst"]
Sep 20 00:48:39.748580 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:39.748549    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a92ad3c_5004_4ec6_a9b0_30d474ee931e.slice/crio-4ecf7c6a2908be9bb47f7f186ccf93d7095e9e7b90d89ed45da0c2f708002bfe WatchSource:0}: Error finding container 4ecf7c6a2908be9bb47f7f186ccf93d7095e9e7b90d89ed45da0c2f708002bfe: Status 404 returned error can't find the container with id 4ecf7c6a2908be9bb47f7f186ccf93d7095e9e7b90d89ed45da0c2f708002bfe
Sep 20 00:48:39.750167 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:39.750143    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1186e9_9378_4dbe_bf23_bba1b4cf75c7.slice/crio-e8887c268b5be039fd010532257ae51596225f9e9990d3b9cf04d820cd332360 WatchSource:0}: Error finding container e8887c268b5be039fd010532257ae51596225f9e9990d3b9cf04d820cd332360: Status 404 returned error can't find the container with id e8887c268b5be039fd010532257ae51596225f9e9990d3b9cf04d820cd332360
Sep 20 00:48:39.781977 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.781939    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9brst" event={"ID":"8a92ad3c-5004-4ec6-a9b0-30d474ee931e","Type":"ContainerStarted","Data":"4ecf7c6a2908be9bb47f7f186ccf93d7095e9e7b90d89ed45da0c2f708002bfe"}
Sep 20 00:48:39.783331 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.783293    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5xk8" event={"ID":"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7","Type":"ContainerStarted","Data":"e8887c268b5be039fd010532257ae51596225f9e9990d3b9cf04d820cd332360"}
Sep 20 00:48:39.784433 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:39.784410    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p8hhh" event={"ID":"89d96c9f-5938-4fae-8377-4623f781d451","Type":"ContainerStarted","Data":"777c5aec79e84756df7ed1ae4a43ad7a94eaf5242e9be7ced015804ae36da1ee"}
Sep 20 00:48:40.076437 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:40.076343    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:40.129086 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:40.129048    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:41.191492 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.191453    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:41.264508 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.264472    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:41.496751 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.496716    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:41.798511 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.798467    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9brst" event={"ID":"8a92ad3c-5004-4ec6-a9b0-30d474ee931e","Type":"ContainerStarted","Data":"458de3947134b455a5faa4fe18c30b228d4c39eb873723c4ec1bf4e75ec7503d"}
Sep 20 00:48:41.798695 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.798529    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9brst" event={"ID":"8a92ad3c-5004-4ec6-a9b0-30d474ee931e","Type":"ContainerStarted","Data":"f87cac4f1c48af3692d670d306c86b836d66540460c6f0703d7e7347c8fd3296"}
Sep 20 00:48:41.815042 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.814977    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9brst" podStartSLOduration=67.569971629 podStartE2EDuration="1m8.814955598s" totalImagesPullingTime="1.244983969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:41.813570035 +0000 UTC m=+68.806845595" watchObservedRunningTime="2026-09-20 00:48:41.814955598 +0000 UTC m=+68.808231131"
Sep 20 00:48:41.934887 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.934842    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:41.992241 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:41.992173    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:42.233261 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:42.233169    2571 patch_prober.go:28] interesting pod/image-registry-7bff5894cb-qfdx8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 20 00:48:42.233691 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:42.233249    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8" podUID="c63d3f74-e958-431d-8377-2692418df143" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 00:48:43.415928 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:43.415892    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:44.809538 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:44.809505    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:44.905947 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:44.905913    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:45.011617 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.011575    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:45.371388 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.371352    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:45.576428 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.576390    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:45.638183 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.638098    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8pwrh"]
Sep 20 00:48:45.643077 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.643052    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.645420 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.645396    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 20 00:48:45.645839 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.645814    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 20 00:48:45.645925 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.645813    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mwr4l\""
Sep 20 00:48:45.646929 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.646843    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 20 00:48:45.646929 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.646872    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 20 00:48:45.647122 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.647001    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 20 00:48:45.647122 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.647093    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 20 00:48:45.679812 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.679785    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:45.776004 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.775956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:45.781207 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvwt9\" (UniqueName: \"kubernetes.io/projected/29322baf-23ee-44d7-84c6-461dfcabce0f-kube-api-access-wvwt9\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781341 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-wtmp\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781341 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781253    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781341 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-sys\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781341 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781329    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-textfile\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781563 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781357    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781563 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-tls\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781563 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-root\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.781563 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.781485    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29322baf-23ee-44d7-84c6-461dfcabce0f-metrics-client-ca\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.882637 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-tls\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-root\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29322baf-23ee-44d7-84c6-461dfcabce0f-metrics-client-ca\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwt9\" (UniqueName: \"kubernetes.io/projected/29322baf-23ee-44d7-84c6-461dfcabce0f-kube-api-access-wvwt9\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882758    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-wtmp\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-sys\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.882960    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-wtmp\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.883010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-textfile\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.883041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883779 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.883162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-root\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883779 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.883283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29322baf-23ee-44d7-84c6-461dfcabce0f-sys\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883779 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.883645    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.883779 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.883717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29322baf-23ee-44d7-84c6-461dfcabce0f-metrics-client-ca\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.884063 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.884036    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-textfile\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.885649 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.885620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-tls\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.885649 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.885630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29322baf-23ee-44d7-84c6-461dfcabce0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.892505 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.892456    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwt9\" (UniqueName: \"kubernetes.io/projected/29322baf-23ee-44d7-84c6-461dfcabce0f-kube-api-access-wvwt9\") pod \"node-exporter-8pwrh\" (UID: \"29322baf-23ee-44d7-84c6-461dfcabce0f\") " pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.954363 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.954331    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8pwrh"
Sep 20 00:48:45.994080 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:45.994006    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:46.294221 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:46.294154    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:46.468480 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:46.468445    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:46.570385 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:46.570298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:46.672986 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:46.672941    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:46.778377 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:46.778300    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:47.138912 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:47.138869    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:47.197871 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:47.197839    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:48.640474 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:48.640439    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:48.738266 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:48.738217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:48.985765 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:48.985678    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:49.144783 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:49.144742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:49.245988 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:49.245903    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:49.346553 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:49.346492    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:50.128463 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:50.128419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:50.185372 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:50.185336    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:50.369542 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:50.369436    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:50.429036 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:50.428956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:50.584500 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:50.584463    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:50.906413 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:50.906371    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:50.971163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:50.971121    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:51.204100 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.204001    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:51.304550 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.304501    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:51.408706 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.408665    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:51.920298 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.920238    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:51.921096 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.921078    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:48:51.925722 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.925700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:51.928334 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.928313    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 20 00:48:51.928454 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.928313    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 20 00:48:51.928517 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.928314    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 20 00:48:51.928902 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.928883    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 20 00:48:51.928976 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.928931    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 20 00:48:51.928976 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.928930    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 20 00:48:51.929448 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.929430    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 20 00:48:51.929511 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.929493    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 20 00:48:51.929549 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.929495    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 20 00:48:51.929923 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.929902    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbz8m\""
Sep 20 00:48:51.930019 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.929925    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 20 00:48:51.930138 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.930120    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 20 00:48:51.930835 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.930690    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 20 00:48:51.930835 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.930724    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1u8na9tdkm065\""
Sep 20 00:48:51.930835 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.930689    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 20 00:48:51.930835 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.930690    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 20 00:48:51.932452 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.932435    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 20 00:48:51.940188 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:51.940167    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:48:52.032961 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.032925    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.032961 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.032965    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.032989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033146    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-web-config\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033364 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033171    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033364 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nptqg\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-kube-api-access-nptqg\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033364 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033364 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033287    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033364 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033364 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033364 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033587 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033379    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033587 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033396    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033587 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033412    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033587 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033587 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033442    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-config-out\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.033587 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.033456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-config\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134118 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134118 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-config-out\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-config\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134286    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134327    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134375 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-web-config\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134395    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nptqg\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-kube-api-access-nptqg\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134501    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134588    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134613    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134668    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.134737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.134678    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.135298 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.135176    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.136881 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.135583    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.136881 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.136348    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.137611 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.137525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-config\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.138036 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.137941    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-config-out\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.138129 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.138064    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.139450 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.138353    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.139450 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.138596    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.139450 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.138879    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.139450 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.138970    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.139703 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.139450    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.140024 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.139916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.140024 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.139919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.140163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.140100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.140441 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.140418    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-web-config\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.140597 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.140580    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.140642 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.140601    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.140844 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.140828    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.145861 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.145838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nptqg\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-kube-api-access-nptqg\") pod \"prometheus-k8s-0\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.182719 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:52.182687    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29322baf_23ee_44d7_84c6_461dfcabce0f.slice/crio-5a3083f170ccbde00de092d25de0b93801119770e81ac2d05165e2ccff2c9114 WatchSource:0}: Error finding container 5a3083f170ccbde00de092d25de0b93801119770e81ac2d05165e2ccff2c9114: Status 404 returned error can't find the container with id 5a3083f170ccbde00de092d25de0b93801119770e81ac2d05165e2ccff2c9114
Sep 20 00:48:52.231608 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.231564    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:52.238166 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.238134    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:48:52.534286 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.534238    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:48:52.539984 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:48:52.539932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb179b019_afa4_4f64_8510_b08191845725.slice/crio-bc9945f7bf120c1a9e6161aee11fab2e5a878f6948ecc063a3c82f43145015f5 WatchSource:0}: Error finding container bc9945f7bf120c1a9e6161aee11fab2e5a878f6948ecc063a3c82f43145015f5: Status 404 returned error can't find the container with id bc9945f7bf120c1a9e6161aee11fab2e5a878f6948ecc063a3c82f43145015f5
Sep 20 00:48:52.849275 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.848735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5xk8" event={"ID":"cb1186e9-9378-4dbe-bf23-bba1b4cf75c7","Type":"ContainerStarted","Data":"5e22f27c8fc2702935f631602f6e90152e1f341e47573370a9e2940304674ed2"}
Sep 20 00:48:52.849275 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.848874    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:48:52.851293 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.850888    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-5wsjj" event={"ID":"87ba91cf-c2b1-49c4-b702-33db98397608","Type":"ContainerStarted","Data":"75ee97cf1546ed645c4dce430fa9bbddb116c56b0492e64814a26936f45944a7"}
Sep 20 00:48:52.851293 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.851093    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-5wsjj"
Sep 20 00:48:52.853725 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.853694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p8hhh" event={"ID":"89d96c9f-5938-4fae-8377-4623f781d451","Type":"ContainerStarted","Data":"237899ab661104adcc8e83a0441682f89c928d16577e383dca45cfaaa0e7aa1b"}
Sep 20 00:48:52.855777 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.855598    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerStarted","Data":"bc9945f7bf120c1a9e6161aee11fab2e5a878f6948ecc063a3c82f43145015f5"}
Sep 20 00:48:52.857367 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.857340    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pwrh" event={"ID":"29322baf-23ee-44d7-84c6-461dfcabce0f","Type":"ContainerStarted","Data":"5a3083f170ccbde00de092d25de0b93801119770e81ac2d05165e2ccff2c9114"}
Sep 20 00:48:52.861717 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.861672    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-5wsjj"
Sep 20 00:48:52.865282 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.865136    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w5xk8" podStartSLOduration=67.438266087 podStartE2EDuration="1m19.865117196s" totalImagesPullingTime="12.426851109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:52.864827428 +0000 UTC m=+79.858102960" watchObservedRunningTime="2026-09-20 00:48:52.865117196 +0000 UTC m=+79.858392730"
Sep 20 00:48:52.885764 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.885705    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-5wsjj" podStartSLOduration=1.383322403 podStartE2EDuration="19.885684377s" totalImagesPullingTime="18.502361974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:52.88442607 +0000 UTC m=+79.877701604" watchObservedRunningTime="2026-09-20 00:48:52.885684377 +0000 UTC m=+79.878959912"
Sep 20 00:48:52.909890 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:52.909825    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p8hhh" podStartSLOduration=67.464703081 podStartE2EDuration="1m19.909804636s" totalImagesPullingTime="12.445101555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:52.908458884 +0000 UTC m=+79.901734418" watchObservedRunningTime="2026-09-20 00:48:52.909804636 +0000 UTC m=+79.903080167"
Sep 20 00:48:53.581815 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:53.581745    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:53.683694 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:53.683652    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:53.863865 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:53.863770    2571 generic.go:356] "Generic (PLEG): container finished" podID="29322baf-23ee-44d7-84c6-461dfcabce0f" containerID="23b7b439c619997418399d111e42dc81bd89e419333e1c7bab34596046f2f8f0" exitCode=0
Sep 20 00:48:53.864038 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:53.863866    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pwrh" event={"ID":"29322baf-23ee-44d7-84c6-461dfcabce0f","Type":"ContainerDied","Data":"23b7b439c619997418399d111e42dc81bd89e419333e1c7bab34596046f2f8f0"}
Sep 20 00:48:54.058050 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.058011    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:54.121341 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.121260    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:54.765053 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.765016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64fbdbc8d8-lsztg"
Sep 20 00:48:54.870426 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.870385    2571 generic.go:356] "Generic (PLEG): container finished" podID="b179b019-afa4-4f64-8510-b08191845725" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9" exitCode=0
Sep 20 00:48:54.870599 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.870478    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"}
Sep 20 00:48:54.873514 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.873484    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pwrh" event={"ID":"29322baf-23ee-44d7-84c6-461dfcabce0f","Type":"ContainerStarted","Data":"ce1b88dc8be1623862aca463f34245fe22c028939443c3907fb49532307586e9"}
Sep 20 00:48:54.873630 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.873543    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8pwrh" event={"ID":"29322baf-23ee-44d7-84c6-461dfcabce0f","Type":"ContainerStarted","Data":"610a1bdf2ab9c0c95b54fc98c0b37a2357b98e6d61ddbd2fbc63ef81cfee9a84"}
Sep 20 00:48:54.884097 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.884016    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:54.919486 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.919428    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8pwrh" podStartSLOduration=8.939231018 podStartE2EDuration="9.919410732s" totalImagesPullingTime="892.299718ms" totalInitContainerRuntime="87.879996ms" isStatefulPod=true podCreationTimestamp="2026-09-20 00:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:54.917896786 +0000 UTC m=+81.911172311" watchObservedRunningTime="2026-09-20 00:48:54.919410732 +0000 UTC m=+81.912686265"
Sep 20 00:48:54.970028 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:54.969990    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:55.574135 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:55.574094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:55.626025 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:55.625984    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:55.918416 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:55.918318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:56.020015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:56.019834    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:56.576548 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:56.576496    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:56.677793 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:56.677675    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:48:57.246601 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:57.246498    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8" podUID="c63d3f74-e958-431d-8377-2692418df143" containerName="registry" containerID="cri-o://47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9" gracePeriod=30
Sep 20 00:48:58.504798 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.504764    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:58.597283 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597206    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fd9j\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-kube-api-access-4fd9j\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597283 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597269    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-registry-certificates\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597510 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597302    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c63d3f74-e958-431d-8377-2692418df143-ca-trust-extracted\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597510 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597335    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-image-registry-private-configuration\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597510 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597359    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-bound-sa-token\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597510 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597419    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-installation-pull-secrets\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597510 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597452    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-trusted-ca\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597510 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597497    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") pod \"c63d3f74-e958-431d-8377-2692418df143\" (UID: \"c63d3f74-e958-431d-8377-2692418df143\") "
Sep 20 00:48:58.597795 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597657    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:48:58.597795 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.597764    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-registry-certificates\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.598764 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.598704    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:48:58.600422 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.600393    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-kube-api-access-4fd9j" (OuterVolumeSpecName: "kube-api-access-4fd9j") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "kube-api-access-4fd9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:48:58.600608 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.600580    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:48:58.600772 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.600724    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:48:58.600882 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.600787    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:48:58.601099 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.601081    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:48:58.608279 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.608252    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63d3f74-e958-431d-8377-2692418df143-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c63d3f74-e958-431d-8377-2692418df143" (UID: "c63d3f74-e958-431d-8377-2692418df143"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:48:58.698229 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.698177    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-registry-tls\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.698229 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.698225    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fd9j\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-kube-api-access-4fd9j\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.698229 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.698236    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c63d3f74-e958-431d-8377-2692418df143-ca-trust-extracted\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.698484 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.698245    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-image-registry-private-configuration\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.698484 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.698255    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c63d3f74-e958-431d-8377-2692418df143-bound-sa-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.698484 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.698264    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c63d3f74-e958-431d-8377-2692418df143-installation-pull-secrets\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.698484 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.698275    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c63d3f74-e958-431d-8377-2692418df143-trusted-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:48:58.894842 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.894810    2571 generic.go:356] "Generic (PLEG): container finished" podID="c63d3f74-e958-431d-8377-2692418df143" containerID="47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9" exitCode=0
Sep 20 00:48:58.894969 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.894876    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8"
Sep 20 00:48:58.894969 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.894940    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8" event={"ID":"c63d3f74-e958-431d-8377-2692418df143","Type":"ContainerDied","Data":"47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9"}
Sep 20 00:48:58.895072 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.894986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bff5894cb-qfdx8" event={"ID":"c63d3f74-e958-431d-8377-2692418df143","Type":"ContainerDied","Data":"fcc042077d3b3c32fcee34831fd3af948d553ddaa8e8417b00782710b4729679"}
Sep 20 00:48:58.895072 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.895016    2571 scope.go:117] "RemoveContainer" containerID="47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9"
Sep 20 00:48:58.905393 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.905367    2571 scope.go:117] "RemoveContainer" containerID="47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9"
Sep 20 00:48:58.905767 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:48:58.905735    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9\": container with ID starting with 47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9 not found: ID does not exist" containerID="47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9"
Sep 20 00:48:58.905868 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.905778    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9"} err="failed to get container status \"47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9\": rpc error: code = NotFound desc = could not find container \"47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9\": container with ID starting with 47dcf12b8bbb91b2aec451800c116f3484d80ab734d416f86e9a08c7890126d9 not found: ID does not exist"
Sep 20 00:48:58.919902 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.919876    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bff5894cb-qfdx8"]
Sep 20 00:48:58.925160 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:58.925134    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bff5894cb-qfdx8"]
Sep 20 00:48:59.508764 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:59.508726    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c63d3f74-e958-431d-8377-2692418df143" path="/var/lib/kubelet/pods/c63d3f74-e958-431d-8377-2692418df143/volumes"
Sep 20 00:48:59.906208 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:59.906110    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerStarted","Data":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"}
Sep 20 00:48:59.906389 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:48:59.906248    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerStarted","Data":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"}
Sep 20 00:49:02.922985 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:02.922949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerStarted","Data":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"}
Sep 20 00:49:02.923492 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:02.923048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerStarted","Data":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"}
Sep 20 00:49:02.923492 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:02.923076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerStarted","Data":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"}
Sep 20 00:49:02.923492 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:02.923099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerStarted","Data":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"}
Sep 20 00:49:02.953073 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:02.953019    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.571516782 podStartE2EDuration="11.953002582s" totalImagesPullingTime="8.357834615s" totalInitContainerRuntime="23.651185ms" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:49:02.951970903 +0000 UTC m=+89.945246435" watchObservedRunningTime="2026-09-20 00:49:02.953002582 +0000 UTC m=+89.946278115"
Sep 20 00:49:03.131820 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:03.131775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:03.232880 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:03.232787    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:06.158983 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:06.158935    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:06.208494 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:06.208458    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:06.261894 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:06.261858    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:07.238594 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:07.238556    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:49:14.794827 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:14.794786    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:14.849680 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:14.849644    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:23.867621 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:23.867591    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w5xk8"
Sep 20 00:49:29.802264 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:29.802183    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:29.861133 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:29.861097    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:39.637818 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:39.637773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:49:52.238592 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:52.238536    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:49:52.257092 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:52.257064    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:49:53.116040 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:53.116007    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:49:53.329557 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:49:53.329519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:04.922443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:04.922402    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:05.167493 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:05.167459    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:10.316271 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.316239    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:50:10.316674 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.316534    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="prometheus" containerID="cri-o://708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37" gracePeriod=600
Sep 20 00:50:10.316674 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.316582    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="thanos-sidecar" containerID="cri-o://20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166" gracePeriod=600
Sep 20 00:50:10.316674 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.316634    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-web" containerID="cri-o://91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e" gracePeriod=600
Sep 20 00:50:10.316674 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.316576    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy" containerID="cri-o://67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c" gracePeriod=600
Sep 20 00:50:10.316868 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.316634    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="config-reloader" containerID="cri-o://d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d" gracePeriod=600
Sep 20 00:50:10.316868 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.316578    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc" gracePeriod=600
Sep 20 00:50:10.545677 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.545651    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:10.560614 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560589    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-0\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560732 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560732 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560690    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-1\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560732 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560727    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-serving-certs-ca-bundle\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560872 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560752    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-config-out\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560872 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560778    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-web-config\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560872 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560803    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-metrics-client-certs\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560872 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560830    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-db\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.560872 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560854    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-tls-assets\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560881    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-tls\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560907    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-kubelet-serving-ca-bundle\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560946    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-thanos-prometheus-http-client-file\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.560975    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561004    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-kube-rbac-proxy\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561050    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-2\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561078    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-grpc-tls\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561084    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:10.561551 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561124    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nptqg\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-kube-api-access-nptqg\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561551 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561123    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:10.561551 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561148    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-config\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561551 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561174    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-metrics-client-ca\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561551 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561228    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-trusted-ca-bundle\") pod \"b179b019-afa4-4f64-8510-b08191845725\" (UID: \"b179b019-afa4-4f64-8510-b08191845725\") "
Sep 20 00:50:10.561551 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561439    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.561551 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561456    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.562101 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561834    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:10.562101 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.561908    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:10.562241 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.562135    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:10.562615 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.562527    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:50:10.563036 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.562918    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:10.563113 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.563051    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:10.565204 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.565137    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:50:10.565624 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.565586    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-config" (OuterVolumeSpecName: "config") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.565624 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.565603    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-config-out" (OuterVolumeSpecName: "config-out") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:50:10.565791 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.565663    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.565791 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.565781    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.565915 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.565870    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.565974 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.565945    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.566085 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.566061    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.566144 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.566105    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.566431 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.566408    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.566931 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.566910    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-kube-api-access-nptqg" (OuterVolumeSpecName: "kube-api-access-nptqg") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "kube-api-access-nptqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:50:10.574862 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.574838    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-web-config" (OuterVolumeSpecName: "web-config") pod "b179b019-afa4-4f64-8510-b08191845725" (UID: "b179b019-afa4-4f64-8510-b08191845725"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:10.662006 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.661977    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662006 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662003    2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-grpc-tls\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662006 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662013    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nptqg\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-kube-api-access-nptqg\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662021    2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-config\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662031    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-metrics-client-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662039    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662049    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662059    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662068    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-config-out\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662096    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-web-config\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662105    2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-metrics-client-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662113    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b179b019-afa4-4f64-8510-b08191845725-prometheus-k8s-db\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662120    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b179b019-afa4-4f64-8510-b08191845725-tls-assets\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662128    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662136    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b179b019-afa4-4f64-8510-b08191845725-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662145    2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662153    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:10.662291 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:10.662161    2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b179b019-afa4-4f64-8510-b08191845725-secret-kube-rbac-proxy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:50:11.171742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171707    2571 generic.go:356] "Generic (PLEG): container finished" podID="b179b019-afa4-4f64-8510-b08191845725" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc" exitCode=0
Sep 20 00:50:11.171742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171735    2571 generic.go:356] "Generic (PLEG): container finished" podID="b179b019-afa4-4f64-8510-b08191845725" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c" exitCode=0
Sep 20 00:50:11.171742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171742    2571 generic.go:356] "Generic (PLEG): container finished" podID="b179b019-afa4-4f64-8510-b08191845725" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e" exitCode=0
Sep 20 00:50:11.171742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171748    2571 generic.go:356] "Generic (PLEG): container finished" podID="b179b019-afa4-4f64-8510-b08191845725" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166" exitCode=0
Sep 20 00:50:11.171742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171753    2571 generic.go:356] "Generic (PLEG): container finished" podID="b179b019-afa4-4f64-8510-b08191845725" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d" exitCode=0
Sep 20 00:50:11.171742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171758    2571 generic.go:356] "Generic (PLEG): container finished" podID="b179b019-afa4-4f64-8510-b08191845725" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37" exitCode=0
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171785    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"}
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171854    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"}
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171796    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171882    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"}
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171914    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"}
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171939    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"}
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171949    2571 scope.go:117] "RemoveContainer" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171970    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"}
Sep 20 00:50:11.172212 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.171999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b179b019-afa4-4f64-8510-b08191845725","Type":"ContainerDied","Data":"bc9945f7bf120c1a9e6161aee11fab2e5a878f6948ecc063a3c82f43145015f5"}
Sep 20 00:50:11.179766 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.179748    2571 scope.go:117] "RemoveContainer" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.186385 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.186368    2571 scope.go:117] "RemoveContainer" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.192891 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.192874    2571 scope.go:117] "RemoveContainer" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.195377 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.195348    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:50:11.199718 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.199696    2571 scope.go:117] "RemoveContainer" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.201885 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.201868    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:50:11.206372 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.206352    2571 scope.go:117] "RemoveContainer" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.212958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.212940    2571 scope.go:117] "RemoveContainer" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.219123 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.219105    2571 scope.go:117] "RemoveContainer" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.219394 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:50:11.219375    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": container with ID starting with f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc not found: ID does not exist" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.219434 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.219404    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"} err="failed to get container status \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": rpc error: code = NotFound desc = could not find container \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": container with ID starting with f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc not found: ID does not exist"
Sep 20 00:50:11.219434 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.219424    2571 scope.go:117] "RemoveContainer" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.219702 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:50:11.219684    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": container with ID starting with 67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c not found: ID does not exist" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.219744 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.219710    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"} err="failed to get container status \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": rpc error: code = NotFound desc = could not find container \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": container with ID starting with 67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c not found: ID does not exist"
Sep 20 00:50:11.219744 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.219726    2571 scope.go:117] "RemoveContainer" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.219968 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:50:11.219951    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": container with ID starting with 91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e not found: ID does not exist" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.220006 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.219972    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"} err="failed to get container status \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": rpc error: code = NotFound desc = could not find container \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": container with ID starting with 91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e not found: ID does not exist"
Sep 20 00:50:11.220006 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.219988    2571 scope.go:117] "RemoveContainer" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.220229 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:50:11.220211    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": container with ID starting with 20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166 not found: ID does not exist" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.220308 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220232    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"} err="failed to get container status \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": rpc error: code = NotFound desc = could not find container \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": container with ID starting with 20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166 not found: ID does not exist"
Sep 20 00:50:11.220308 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220245    2571 scope.go:117] "RemoveContainer" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.220450 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:50:11.220431    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": container with ID starting with d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d not found: ID does not exist" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.220487 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220454    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"} err="failed to get container status \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": rpc error: code = NotFound desc = could not find container \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": container with ID starting with d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d not found: ID does not exist"
Sep 20 00:50:11.220487 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220468    2571 scope.go:117] "RemoveContainer" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.220703 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:50:11.220687    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": container with ID starting with 708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37 not found: ID does not exist" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.220750 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220707    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"} err="failed to get container status \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": rpc error: code = NotFound desc = could not find container \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": container with ID starting with 708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37 not found: ID does not exist"
Sep 20 00:50:11.220750 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220723    2571 scope.go:117] "RemoveContainer" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.220934 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:50:11.220920    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": container with ID starting with 808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9 not found: ID does not exist" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.220984 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220934    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"} err="failed to get container status \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": rpc error: code = NotFound desc = could not find container \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": container with ID starting with 808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9 not found: ID does not exist"
Sep 20 00:50:11.220984 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.220945    2571 scope.go:117] "RemoveContainer" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.221140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221125    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"} err="failed to get container status \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": rpc error: code = NotFound desc = could not find container \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": container with ID starting with f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc not found: ID does not exist"
Sep 20 00:50:11.221185 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221141    2571 scope.go:117] "RemoveContainer" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.221369 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221354    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"} err="failed to get container status \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": rpc error: code = NotFound desc = could not find container \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": container with ID starting with 67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c not found: ID does not exist"
Sep 20 00:50:11.221422 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221369    2571 scope.go:117] "RemoveContainer" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.221595 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221580    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"} err="failed to get container status \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": rpc error: code = NotFound desc = could not find container \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": container with ID starting with 91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e not found: ID does not exist"
Sep 20 00:50:11.221595 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221594    2571 scope.go:117] "RemoveContainer" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.221775 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221758    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"} err="failed to get container status \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": rpc error: code = NotFound desc = could not find container \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": container with ID starting with 20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166 not found: ID does not exist"
Sep 20 00:50:11.221775 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221775    2571 scope.go:117] "RemoveContainer" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.221958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221944    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"} err="failed to get container status \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": rpc error: code = NotFound desc = could not find container \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": container with ID starting with d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d not found: ID does not exist"
Sep 20 00:50:11.222000 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.221959    2571 scope.go:117] "RemoveContainer" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.222181 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222161    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"} err="failed to get container status \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": rpc error: code = NotFound desc = could not find container \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": container with ID starting with 708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37 not found: ID does not exist"
Sep 20 00:50:11.222333 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222181    2571 scope.go:117] "RemoveContainer" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.222406 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222387    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"} err="failed to get container status \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": rpc error: code = NotFound desc = could not find container \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": container with ID starting with 808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9 not found: ID does not exist"
Sep 20 00:50:11.222448 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222407    2571 scope.go:117] "RemoveContainer" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.222632 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222616    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"} err="failed to get container status \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": rpc error: code = NotFound desc = could not find container \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": container with ID starting with f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc not found: ID does not exist"
Sep 20 00:50:11.222682 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222632    2571 scope.go:117] "RemoveContainer" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.222864 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222848    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"} err="failed to get container status \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": rpc error: code = NotFound desc = could not find container \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": container with ID starting with 67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c not found: ID does not exist"
Sep 20 00:50:11.222864 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.222864    2571 scope.go:117] "RemoveContainer" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.223253 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.223172    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"} err="failed to get container status \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": rpc error: code = NotFound desc = could not find container \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": container with ID starting with 91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e not found: ID does not exist"
Sep 20 00:50:11.223253 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.223218    2571 scope.go:117] "RemoveContainer" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.223690 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.223669    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"} err="failed to get container status \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": rpc error: code = NotFound desc = could not find container \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": container with ID starting with 20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166 not found: ID does not exist"
Sep 20 00:50:11.223775 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.223690    2571 scope.go:117] "RemoveContainer" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.223989 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.223970    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"} err="failed to get container status \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": rpc error: code = NotFound desc = could not find container \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": container with ID starting with d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d not found: ID does not exist"
Sep 20 00:50:11.224050 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.223990    2571 scope.go:117] "RemoveContainer" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.224262 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224242    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"} err="failed to get container status \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": rpc error: code = NotFound desc = could not find container \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": container with ID starting with 708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37 not found: ID does not exist"
Sep 20 00:50:11.224332 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224262    2571 scope.go:117] "RemoveContainer" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.224482 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224465    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"} err="failed to get container status \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": rpc error: code = NotFound desc = could not find container \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": container with ID starting with 808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9 not found: ID does not exist"
Sep 20 00:50:11.224548 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224481    2571 scope.go:117] "RemoveContainer" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.224691 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224672    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"} err="failed to get container status \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": rpc error: code = NotFound desc = could not find container \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": container with ID starting with f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc not found: ID does not exist"
Sep 20 00:50:11.224747 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224690    2571 scope.go:117] "RemoveContainer" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.224794 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224760    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:50:11.224899 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224881    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"} err="failed to get container status \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": rpc error: code = NotFound desc = could not find container \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": container with ID starting with 67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c not found: ID does not exist"
Sep 20 00:50:11.224954 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.224899    2571 scope.go:117] "RemoveContainer" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.225067 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225052    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="prometheus"
Sep 20 00:50:11.225149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225072    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="prometheus"
Sep 20 00:50:11.225149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225085    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="config-reloader"
Sep 20 00:50:11.225149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225093    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="config-reloader"
Sep 20 00:50:11.225149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225102    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-thanos"
Sep 20 00:50:11.225149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225110    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-thanos"
Sep 20 00:50:11.225149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225114    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"} err="failed to get container status \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": rpc error: code = NotFound desc = could not find container \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": container with ID starting with 91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e not found: ID does not exist"
Sep 20 00:50:11.225149 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225129    2571 scope.go:117] "RemoveContainer" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225121    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c63d3f74-e958-431d-8377-2692418df143" containerName="registry"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225174    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63d3f74-e958-431d-8377-2692418df143" containerName="registry"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225185    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225219    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225242    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="init-config-reloader"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225250    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="init-config-reloader"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225267    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="thanos-sidecar"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225275    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="thanos-sidecar"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225287    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-web"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225293    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-web"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225371    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-thanos"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225386    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="prometheus"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225392    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c63d3f74-e958-431d-8377-2692418df143" containerName="registry"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225398    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="thanos-sidecar"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225403    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy-web"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225408    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="kube-rbac-proxy"
Sep 20 00:50:11.225443 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225413    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b179b019-afa4-4f64-8510-b08191845725" containerName="config-reloader"
Sep 20 00:50:11.226020 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225453    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"} err="failed to get container status \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": rpc error: code = NotFound desc = could not find container \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": container with ID starting with 20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166 not found: ID does not exist"
Sep 20 00:50:11.226020 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225468    2571 scope.go:117] "RemoveContainer" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.226020 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225687    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"} err="failed to get container status \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": rpc error: code = NotFound desc = could not find container \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": container with ID starting with d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d not found: ID does not exist"
Sep 20 00:50:11.226020 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225710    2571 scope.go:117] "RemoveContainer" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.226020 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225924    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"} err="failed to get container status \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": rpc error: code = NotFound desc = could not find container \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": container with ID starting with 708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37 not found: ID does not exist"
Sep 20 00:50:11.226020 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.225949    2571 scope.go:117] "RemoveContainer" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.226259 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226235    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"} err="failed to get container status \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": rpc error: code = NotFound desc = could not find container \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": container with ID starting with 808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9 not found: ID does not exist"
Sep 20 00:50:11.226259 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226250    2571 scope.go:117] "RemoveContainer" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.226497 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226479    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"} err="failed to get container status \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": rpc error: code = NotFound desc = could not find container \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": container with ID starting with f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc not found: ID does not exist"
Sep 20 00:50:11.226565 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226499    2571 scope.go:117] "RemoveContainer" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.226745 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226728    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"} err="failed to get container status \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": rpc error: code = NotFound desc = could not find container \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": container with ID starting with 67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c not found: ID does not exist"
Sep 20 00:50:11.226816 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226746    2571 scope.go:117] "RemoveContainer" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.226992 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226973    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"} err="failed to get container status \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": rpc error: code = NotFound desc = could not find container \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": container with ID starting with 91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e not found: ID does not exist"
Sep 20 00:50:11.227032 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.226992    2571 scope.go:117] "RemoveContainer" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.227234 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227217    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"} err="failed to get container status \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": rpc error: code = NotFound desc = could not find container \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": container with ID starting with 20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166 not found: ID does not exist"
Sep 20 00:50:11.227282 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227234    2571 scope.go:117] "RemoveContainer" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.227474 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227456    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"} err="failed to get container status \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": rpc error: code = NotFound desc = could not find container \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": container with ID starting with d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d not found: ID does not exist"
Sep 20 00:50:11.227516 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227475    2571 scope.go:117] "RemoveContainer" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.227665 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227649    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"} err="failed to get container status \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": rpc error: code = NotFound desc = could not find container \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": container with ID starting with 708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37 not found: ID does not exist"
Sep 20 00:50:11.227705 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227666    2571 scope.go:117] "RemoveContainer" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.227888 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227871    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"} err="failed to get container status \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": rpc error: code = NotFound desc = could not find container \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": container with ID starting with 808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9 not found: ID does not exist"
Sep 20 00:50:11.227932 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.227888    2571 scope.go:117] "RemoveContainer" containerID="f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"
Sep 20 00:50:11.228075 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228058    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc"} err="failed to get container status \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": rpc error: code = NotFound desc = could not find container \"f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc\": container with ID starting with f9204b73a4817b0bb20dd1e742fca3096745f3fe883b7cc46d84bc19982b29bc not found: ID does not exist"
Sep 20 00:50:11.228137 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228075    2571 scope.go:117] "RemoveContainer" containerID="67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"
Sep 20 00:50:11.228296 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228279    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c"} err="failed to get container status \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": rpc error: code = NotFound desc = could not find container \"67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c\": container with ID starting with 67016b6646077ed0f358b62687c0c19f4ad33b7fb86fed52f74238a2c823426c not found: ID does not exist"
Sep 20 00:50:11.228367 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228296    2571 scope.go:117] "RemoveContainer" containerID="91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"
Sep 20 00:50:11.228367 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228315    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.228523 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228500    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e"} err="failed to get container status \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": rpc error: code = NotFound desc = could not find container \"91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e\": container with ID starting with 91e88cfd11f98ce49f78fe62d1fa823d8e25aa131c99a0d8c7cd19c46128016e not found: ID does not exist"
Sep 20 00:50:11.228523 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228521    2571 scope.go:117] "RemoveContainer" containerID="20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"
Sep 20 00:50:11.228956 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228934    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166"} err="failed to get container status \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": rpc error: code = NotFound desc = could not find container \"20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166\": container with ID starting with 20264d9dc1e3e1471e052c44145685e694e1ca6e47c8f1a6ea70827437bb1166 not found: ID does not exist"
Sep 20 00:50:11.228956 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.228954    2571 scope.go:117] "RemoveContainer" containerID="d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"
Sep 20 00:50:11.229223 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.229187    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d"} err="failed to get container status \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": rpc error: code = NotFound desc = could not find container \"d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d\": container with ID starting with d93323423a129216aa8ec7552d2398cf33500c5f9a6a0a82baa54ee5a09af59d not found: ID does not exist"
Sep 20 00:50:11.229223 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.229223    2571 scope.go:117] "RemoveContainer" containerID="708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"
Sep 20 00:50:11.229449 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.229430    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37"} err="failed to get container status \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": rpc error: code = NotFound desc = could not find container \"708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37\": container with ID starting with 708c5b5cdcb32f9893cd7fe0af226dfa564587794cd332d164efb1dfaf69bc37 not found: ID does not exist"
Sep 20 00:50:11.229497 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.229450    2571 scope.go:117] "RemoveContainer" containerID="808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"
Sep 20 00:50:11.229686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.229663    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9"} err="failed to get container status \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": rpc error: code = NotFound desc = could not find container \"808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9\": container with ID starting with 808c744da82986c3b0fa52555b5a6379c0bd83de81605577d7a3eda3502b20b9 not found: ID does not exist"
Sep 20 00:50:11.230691 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.230670    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 20 00:50:11.230898 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.230879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbz8m\""
Sep 20 00:50:11.230968 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.230940    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1u8na9tdkm065\""
Sep 20 00:50:11.231029 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.230946    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 20 00:50:11.231029 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.230996    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 20 00:50:11.231124 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231091    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 20 00:50:11.231221 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231187    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 20 00:50:11.231914 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231885    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 20 00:50:11.232009 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231889    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 20 00:50:11.232009 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231963    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 20 00:50:11.232009 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231890    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 20 00:50:11.232167 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231967    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 20 00:50:11.232167 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.231890    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 20 00:50:11.232416 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.232397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 20 00:50:11.232509 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.232498    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 20 00:50:11.233605 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.233586    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 20 00:50:11.235942 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.235922    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 20 00:50:11.249339 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.249319    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:50:11.266404 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266379    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266493 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266409    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266493 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266493 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266493 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d36068-fa61-42af-9326-2de34d2c30ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266647 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266647 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr96g\" (UniqueName: \"kubernetes.io/projected/42d36068-fa61-42af-9326-2de34d2c30ba-kube-api-access-qr96g\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266647 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266570    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266647 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266585    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266647 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266607    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266647 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266647 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266813    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-config\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.266958 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d36068-fa61-42af-9326-2de34d2c30ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.267166 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.266978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367458 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr96g\" (UniqueName: \"kubernetes.io/projected/42d36068-fa61-42af-9326-2de34d2c30ba-kube-api-access-qr96g\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367696    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367721    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-config\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367784    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d36068-fa61-42af-9326-2de34d2c30ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.367924 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.368846 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.368846 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.367965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d36068-fa61-42af-9326-2de34d2c30ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.368846 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.368470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.368846 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.368505    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.369056 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.368873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.369373 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.369119    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.370630 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.370604    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.370729 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.370611    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.370729 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.370638    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d36068-fa61-42af-9326-2de34d2c30ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.371179 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.371152    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.371298 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.371256    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.371511 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.371482    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-config\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.371584 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.371551    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.371757 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.371717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.372061 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.372037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42d36068-fa61-42af-9326-2de34d2c30ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.372796 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.372768    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d36068-fa61-42af-9326-2de34d2c30ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.372925 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.372902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.373054 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.373031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.373369 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.373349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.373772 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.373750    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.373856 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.373837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d36068-fa61-42af-9326-2de34d2c30ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.375376 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.375355    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr96g\" (UniqueName: \"kubernetes.io/projected/42d36068-fa61-42af-9326-2de34d2c30ba-kube-api-access-qr96g\") pod \"prometheus-k8s-0\" (UID: \"42d36068-fa61-42af-9326-2de34d2c30ba\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.510744 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.508502    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b179b019-afa4-4f64-8510-b08191845725" path="/var/lib/kubelet/pods/b179b019-afa4-4f64-8510-b08191845725/volumes"
Sep 20 00:50:11.537969 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.537929    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:11.817635 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:11.817556    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 20 00:50:11.819603 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:50:11.819578    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d36068_fa61_42af_9326_2de34d2c30ba.slice/crio-ca3492e956a7dbe403833bd01fc96f23afdb3d812deb2840495a62e8a48d0443 WatchSource:0}: Error finding container ca3492e956a7dbe403833bd01fc96f23afdb3d812deb2840495a62e8a48d0443: Status 404 returned error can't find the container with id ca3492e956a7dbe403833bd01fc96f23afdb3d812deb2840495a62e8a48d0443
Sep 20 00:50:12.177301 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:12.177211    2571 generic.go:356] "Generic (PLEG): container finished" podID="42d36068-fa61-42af-9326-2de34d2c30ba" containerID="ba5b2b9969bfd1f1a5db0289d10d46c2d3a8815b669df6f49216e7d9c0a0410e" exitCode=0
Sep 20 00:50:12.177454 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:12.177297    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerDied","Data":"ba5b2b9969bfd1f1a5db0289d10d46c2d3a8815b669df6f49216e7d9c0a0410e"}
Sep 20 00:50:12.177454 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:12.177368    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerStarted","Data":"ca3492e956a7dbe403833bd01fc96f23afdb3d812deb2840495a62e8a48d0443"}
Sep 20 00:50:13.186393 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.186356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerStarted","Data":"f106ee721e02783e58cae1c1195edeac1e7b71eefc9cecf130264c07e5ef96b7"}
Sep 20 00:50:13.186847 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.186422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerStarted","Data":"0f7a633ef133961ef2985c2fcef39546e553f6858d95df6dbc97e9ee6a920856"}
Sep 20 00:50:13.186847 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.186447    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerStarted","Data":"fdc17da05077ceeb3384eab5f4ab388aaad8c86fe7aee66b243c7b165d6eae12"}
Sep 20 00:50:13.186847 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.186471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerStarted","Data":"d16cabe908e5d448a9f44b2af49f75a0f9c5cc7d539e95a5f4947c2fff26a65b"}
Sep 20 00:50:13.186847 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.186496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerStarted","Data":"c99ae02c1ed3cc66b9dcf4082d0e963f32140389c0c55a52e028ece3a92e63f7"}
Sep 20 00:50:13.186847 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.186518    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42d36068-fa61-42af-9326-2de34d2c30ba","Type":"ContainerStarted","Data":"1ddba935dc3e52a2871b220fe5f66c0d9c77e6a6adfdf25b0f1e965093799812"}
Sep 20 00:50:13.212693 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.212640    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.193578878 podStartE2EDuration="2.212622269s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.043391ms" isStatefulPod=false podCreationTimestamp="2026-09-20 00:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:50:13.211238195 +0000 UTC m=+160.204513731" watchObservedRunningTime="2026-09-20 00:50:13.212622269 +0000 UTC m=+160.205897802"
Sep 20 00:50:13.445938 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.445852    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:13.507269 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.507232    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:13.590458 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.590420    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:13.644366 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:13.644332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:14.189079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:14.189032    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:14.277015 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:14.276982    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:16.538916 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:16.538873    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:50:24.495086 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:24.495047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:24.595388 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:24.595354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:36.662865 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:36.662829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:50:48.314309 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:50:48.314271    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:11.538514 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:11.538481    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:51:11.552914 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:11.552890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:51:12.408398 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:12.408370    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 20 00:51:20.159570 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:20.159529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:20.260209 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:20.260155    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:20.996980 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:20.996943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:21.046567 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:21.046533    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:21.177414 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:21.177375    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:21.278163 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:21.278087    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:21.749467 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:21.749440    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:21.798559 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:21.798529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:31.764786 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:31.764732    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:31.820806 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:31.820772    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:31.874424 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:31.874396    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:32.115776 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:32.115697    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:32.217281 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:32.217245    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:44.818051 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:44.818012    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:44.910591 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:44.910552    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:45.486072 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:45.486042    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:51:45.580598 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:51:45.580565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:52:02.638761 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:52:02.638721    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:52:02.712971 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:52:02.712938    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:52:02.782554 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:52:02.782517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:52:33.417232 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:52:33.417187    2571 kubelet.go:1648] "Image garbage collection succeeded"
Sep 20 00:52:57.546476 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:52:57.546437    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:52:58.706344 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:52:58.706317    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:10.695063 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:10.695027    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:19.185265 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:19.185220    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:19.975462 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:19.975428    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:22.805158 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:22.805131    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:22.906226 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:22.906178    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:24.639923 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:24.639889    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:24.734147 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:24.734121    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:24.924401 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:24.924342    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:25.031538 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:25.031518    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:26.845589 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:26.845510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:27.032799 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:27.032768    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:29.587800 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:29.587767    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:29.643109 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:29.643082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:35.244936 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.244900    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:35.385135 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.385105    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qjzjg"]
Sep 20 00:53:35.388066 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.388049    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.390416 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.390397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-74pjq\""
Sep 20 00:53:35.390416 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.390405    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 20 00:53:35.391495 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.391466    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 20 00:53:35.397578 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.397558    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qjzjg"]
Sep 20 00:53:35.547253 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.547231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rmx\" (UniqueName: \"kubernetes.io/projected/f04c963f-7084-4eea-b93d-1bfee801aba4-kube-api-access-k6rmx\") pod \"cert-manager-55b4d954d5-qjzjg\" (UID: \"f04c963f-7084-4eea-b93d-1bfee801aba4\") " pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.547349 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.547282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f04c963f-7084-4eea-b93d-1bfee801aba4-bound-sa-token\") pod \"cert-manager-55b4d954d5-qjzjg\" (UID: \"f04c963f-7084-4eea-b93d-1bfee801aba4\") " pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.648288 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.648263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f04c963f-7084-4eea-b93d-1bfee801aba4-bound-sa-token\") pod \"cert-manager-55b4d954d5-qjzjg\" (UID: \"f04c963f-7084-4eea-b93d-1bfee801aba4\") " pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.648363 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.648298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rmx\" (UniqueName: \"kubernetes.io/projected/f04c963f-7084-4eea-b93d-1bfee801aba4-kube-api-access-k6rmx\") pod \"cert-manager-55b4d954d5-qjzjg\" (UID: \"f04c963f-7084-4eea-b93d-1bfee801aba4\") " pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.656998 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.656971    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f04c963f-7084-4eea-b93d-1bfee801aba4-bound-sa-token\") pod \"cert-manager-55b4d954d5-qjzjg\" (UID: \"f04c963f-7084-4eea-b93d-1bfee801aba4\") " pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.657135 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.657119    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rmx\" (UniqueName: \"kubernetes.io/projected/f04c963f-7084-4eea-b93d-1bfee801aba4-kube-api-access-k6rmx\") pod \"cert-manager-55b4d954d5-qjzjg\" (UID: \"f04c963f-7084-4eea-b93d-1bfee801aba4\") " pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.706125 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.706096    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qjzjg"
Sep 20 00:53:35.970466 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.970401    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qjzjg"]
Sep 20 00:53:35.973139 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:53:35.973116    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf04c963f_7084_4eea_b93d_1bfee801aba4.slice/crio-cb2d017892795f2954595923e7ddee8786b2508e693f2f867fc431f4a7f4cd9c WatchSource:0}: Error finding container cb2d017892795f2954595923e7ddee8786b2508e693f2f867fc431f4a7f4cd9c: Status 404 returned error can't find the container with id cb2d017892795f2954595923e7ddee8786b2508e693f2f867fc431f4a7f4cd9c
Sep 20 00:53:35.974964 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:35.974947    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:53:36.868224 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:36.868164    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qjzjg" event={"ID":"f04c963f-7084-4eea-b93d-1bfee801aba4","Type":"ContainerStarted","Data":"cb2d017892795f2954595923e7ddee8786b2508e693f2f867fc431f4a7f4cd9c"}
Sep 20 00:53:37.858592 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:37.858519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:37.959134 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:37.959076    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:39.536138 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.536109    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"]
Sep 20 00:53:39.539164 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.539148    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.541653 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.541632    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 20 00:53:39.542591 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.542563    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:53:39.542683 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.542563    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-74qtk\""
Sep 20 00:53:39.547156 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.547134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"]
Sep 20 00:53:39.681091 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.681066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d03a6390-7789-4397-b5c2-cfd99483cef3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jxp74\" (UID: \"d03a6390-7789-4397-b5c2-cfd99483cef3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.681183 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.681094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gms5\" (UniqueName: \"kubernetes.io/projected/d03a6390-7789-4397-b5c2-cfd99483cef3-kube-api-access-6gms5\") pod \"openshift-lws-operator-fd8ccff4c-jxp74\" (UID: \"d03a6390-7789-4397-b5c2-cfd99483cef3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.782355 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.782332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d03a6390-7789-4397-b5c2-cfd99483cef3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jxp74\" (UID: \"d03a6390-7789-4397-b5c2-cfd99483cef3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.782430 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.782364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gms5\" (UniqueName: \"kubernetes.io/projected/d03a6390-7789-4397-b5c2-cfd99483cef3-kube-api-access-6gms5\") pod \"openshift-lws-operator-fd8ccff4c-jxp74\" (UID: \"d03a6390-7789-4397-b5c2-cfd99483cef3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.782719 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.782704    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d03a6390-7789-4397-b5c2-cfd99483cef3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jxp74\" (UID: \"d03a6390-7789-4397-b5c2-cfd99483cef3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.794974 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.794928    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gms5\" (UniqueName: \"kubernetes.io/projected/d03a6390-7789-4397-b5c2-cfd99483cef3-kube-api-access-6gms5\") pod \"openshift-lws-operator-fd8ccff4c-jxp74\" (UID: \"d03a6390-7789-4397-b5c2-cfd99483cef3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.847816 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.847788    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"
Sep 20 00:53:39.880071 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.880048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qjzjg" event={"ID":"f04c963f-7084-4eea-b93d-1bfee801aba4","Type":"ContainerStarted","Data":"1def8d276d80e44d2e925b71b748c5e3ed5de8a9d3e1af7c6b188acf0b40e3e0"}
Sep 20 00:53:39.896545 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:39.896499    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qjzjg" podStartSLOduration=2.029703552 podStartE2EDuration="4.896484665s" totalImagesPullingTime="2.866781113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:53:39.894710989 +0000 UTC m=+366.887986522" watchObservedRunningTime="2026-09-20 00:53:39.896484665 +0000 UTC m=+366.889760197"
Sep 20 00:53:40.116838 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:40.116768    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74"]
Sep 20 00:53:40.119386 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:53:40.119356    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd03a6390_7789_4397_b5c2_cfd99483cef3.slice/crio-3a09d820d3509a293b27d3ec96d460722a5bb261b85409f582633a3d41fb0b28 WatchSource:0}: Error finding container 3a09d820d3509a293b27d3ec96d460722a5bb261b85409f582633a3d41fb0b28: Status 404 returned error can't find the container with id 3a09d820d3509a293b27d3ec96d460722a5bb261b85409f582633a3d41fb0b28
Sep 20 00:53:40.886757 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:40.886715    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74" event={"ID":"d03a6390-7789-4397-b5c2-cfd99483cef3","Type":"ContainerStarted","Data":"3a09d820d3509a293b27d3ec96d460722a5bb261b85409f582633a3d41fb0b28"}
Sep 20 00:53:42.895568 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:42.895488    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74" event={"ID":"d03a6390-7789-4397-b5c2-cfd99483cef3","Type":"ContainerStarted","Data":"c903b2b44d07e407f031b22e39de55b6055120fa2709435be709d0b7b83a92c2"}
Sep 20 00:53:42.911336 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:42.911290    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jxp74" podStartSLOduration=1.468235389 podStartE2EDuration="3.911276206s" totalImagesPullingTime="2.443040817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:53:42.910295437 +0000 UTC m=+369.903570947" watchObservedRunningTime="2026-09-20 00:53:42.911276206 +0000 UTC m=+369.904551737"
Sep 20 00:53:43.579348 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:43.579315    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:43.680281 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:43.680251    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:44.020875 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:44.020846    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:44.085309 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:44.085283    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:44.158941 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:44.158923    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:44.260160 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:44.260132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:44.760594 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:44.760569    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:45.807610 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:45.807580    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:49.948374 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:49.948339    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:55.357389 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:55.357350    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:55.408552 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:55.408512    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:53:55.464940 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:53:55.464917    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:01.219610 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:01.219570    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:01.320066 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:01.320029    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:01.846433 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:01.846404    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.053124 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.053094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.154970 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.154916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.208884 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.208854    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"]
Sep 20 00:54:02.272976 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.272954    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"]
Sep 20 00:54:02.273324 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.273042    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.276260 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.276235    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wtnkv\""
Sep 20 00:54:02.276374 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.276311    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 20 00:54:02.276374 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.276320    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 20 00:54:02.276498 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.276392    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 20 00:54:02.276549 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.276514    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 20 00:54:02.324121 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.324101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8p6\" (UniqueName: \"kubernetes.io/projected/2b8b87d4-53ac-47d0-8221-5e639b223b85-kube-api-access-lh8p6\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.324224 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.324129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b8b87d4-53ac-47d0-8221-5e639b223b85-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.324224 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.324151    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b8b87d4-53ac-47d0-8221-5e639b223b85-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.324224 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.324167    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b8b87d4-53ac-47d0-8221-5e639b223b85-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.324342 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.324252    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b8b87d4-53ac-47d0-8221-5e639b223b85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.400738 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.400712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.424953 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.424895    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8p6\" (UniqueName: \"kubernetes.io/projected/2b8b87d4-53ac-47d0-8221-5e639b223b85-kube-api-access-lh8p6\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.424953 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.424945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b8b87d4-53ac-47d0-8221-5e639b223b85-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.425094 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.424982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b8b87d4-53ac-47d0-8221-5e639b223b85-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.425094 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.425010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b8b87d4-53ac-47d0-8221-5e639b223b85-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.425094 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.425046    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b8b87d4-53ac-47d0-8221-5e639b223b85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.425532 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.425510    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b8b87d4-53ac-47d0-8221-5e639b223b85-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.427724 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.427671    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b8b87d4-53ac-47d0-8221-5e639b223b85-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.427829 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.427757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b8b87d4-53ac-47d0-8221-5e639b223b85-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.427986 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.427968    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b8b87d4-53ac-47d0-8221-5e639b223b85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.433938 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.433851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8p6\" (UniqueName: \"kubernetes.io/projected/2b8b87d4-53ac-47d0-8221-5e639b223b85-kube-api-access-lh8p6\") pod \"opendatahub-operator-controller-manager-99bfbc77d-psdlk\" (UID: \"2b8b87d4-53ac-47d0-8221-5e639b223b85\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.492079 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.492054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.581784 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.581763    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:02.595726 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.595700    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.665030 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.665001    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.737533 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.737468    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.837770 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.837736    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.874594 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.874572    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"]
Sep 20 00:54:02.876173 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:54:02.876148    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8b87d4_53ac_47d0_8221_5e639b223b85.slice/crio-d777fb54ad914a1e4a6ccb83acdb57161069d026daf89aef2fca55e1924578e1 WatchSource:0}: Error finding container d777fb54ad914a1e4a6ccb83acdb57161069d026daf89aef2fca55e1924578e1: Status 404 returned error can't find the container with id d777fb54ad914a1e4a6ccb83acdb57161069d026daf89aef2fca55e1924578e1
Sep 20 00:54:02.934155 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.934133    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:02.964675 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:02.964651    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk" event={"ID":"2b8b87d4-53ac-47d0-8221-5e639b223b85","Type":"ContainerStarted","Data":"d777fb54ad914a1e4a6ccb83acdb57161069d026daf89aef2fca55e1924578e1"}
Sep 20 00:54:03.034757 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:03.034728    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:05.979397 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:05.979367    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk" event={"ID":"2b8b87d4-53ac-47d0-8221-5e639b223b85","Type":"ContainerStarted","Data":"971facebca03c3e9db83f46818e61c0c6e9cc55980a0fdcdb4a185e079f64041"}
Sep 20 00:54:06.119805 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:06.119743    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:06.220684 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:06.220657    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:06.984783 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:06.984757    2571 generic.go:356] "Generic (PLEG): container finished" podID="2b8b87d4-53ac-47d0-8221-5e639b223b85" containerID="971facebca03c3e9db83f46818e61c0c6e9cc55980a0fdcdb4a185e079f64041" exitCode=0
Sep 20 00:54:06.985101 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:06.984840    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk" event={"ID":"2b8b87d4-53ac-47d0-8221-5e639b223b85","Type":"ContainerDied","Data":"971facebca03c3e9db83f46818e61c0c6e9cc55980a0fdcdb4a185e079f64041"}
Sep 20 00:54:07.991141 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:07.991102    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk" event={"ID":"2b8b87d4-53ac-47d0-8221-5e639b223b85","Type":"ContainerStarted","Data":"bbae49946b7193e0309039b20ec7f6e0d99f55cf82e77f7d09cc002feb26e2da"}
Sep 20 00:54:07.991657 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:07.991240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:08.015782 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:08.015743    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk" podStartSLOduration=1.685642635 podStartE2EDuration="6.015730418s" totalImagesPullingTime="3.309948881s" totalInitContainerRuntime="1.020138902s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:08.013507374 +0000 UTC m=+395.006782906" watchObservedRunningTime="2026-09-20 00:54:08.015730418 +0000 UTC m=+395.009005949"
Sep 20 00:54:18.997301 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:18.997265    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-psdlk"
Sep 20 00:54:21.206085 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.206049    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:21.309454 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.309405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:21.623912 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.623876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:21.681631 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.681599    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"]
Sep 20 00:54:21.689654 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.689627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.696799 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.696781    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 20 00:54:21.697012 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.696817    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 20 00:54:21.697172 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.697134    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 20 00:54:21.697744 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.697723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 20 00:54:21.697997 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.697982    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2fnt2\""
Sep 20 00:54:21.712389 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.712364    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"]
Sep 20 00:54:21.744577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.744557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66db052b-2a4d-4f34-8529-9ad9f2becf63-tmp\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.744686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.744588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66db052b-2a4d-4f34-8529-9ad9f2becf63-tls-certs\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.744686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.744623    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnb5c\" (UniqueName: \"kubernetes.io/projected/66db052b-2a4d-4f34-8529-9ad9f2becf63-kube-api-access-bnb5c\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.845135 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.845105    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66db052b-2a4d-4f34-8529-9ad9f2becf63-tmp\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.845135 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.845137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66db052b-2a4d-4f34-8529-9ad9f2becf63-tls-certs\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.845370 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.845167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnb5c\" (UniqueName: \"kubernetes.io/projected/66db052b-2a4d-4f34-8529-9ad9f2becf63-kube-api-access-bnb5c\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.847404 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.847381    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66db052b-2a4d-4f34-8529-9ad9f2becf63-tmp\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.847586 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.847567    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66db052b-2a4d-4f34-8529-9ad9f2becf63-tls-certs\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.853398 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.853369    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:21.856540 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.856519    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnb5c\" (UniqueName: \"kubernetes.io/projected/66db052b-2a4d-4f34-8529-9ad9f2becf63-kube-api-access-bnb5c\") pod \"kube-auth-proxy-9c7c6d7b-pkc2d\" (UID: \"66db052b-2a4d-4f34-8529-9ad9f2becf63\") " pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:21.999687 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:21.999634    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"
Sep 20 00:54:22.291536 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:22.291511    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d"]
Sep 20 00:54:22.293690 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:54:22.293663    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66db052b_2a4d_4f34_8529_9ad9f2becf63.slice/crio-9e123a1f70db97e3c81e85cf563b3d565d2abac1b2b9f138b1961371c618983a WatchSource:0}: Error finding container 9e123a1f70db97e3c81e85cf563b3d565d2abac1b2b9f138b1961371c618983a: Status 404 returned error can't find the container with id 9e123a1f70db97e3c81e85cf563b3d565d2abac1b2b9f138b1961371c618983a
Sep 20 00:54:22.937914 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:22.937861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:23.004555 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:23.004505    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:23.057927 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:23.057860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d" event={"ID":"66db052b-2a4d-4f34-8529-9ad9f2becf63","Type":"ContainerStarted","Data":"9e123a1f70db97e3c81e85cf563b3d565d2abac1b2b9f138b1961371c618983a"}
Sep 20 00:54:23.827018 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:23.826977    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:25.067556 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:25.067525    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d" event={"ID":"66db052b-2a4d-4f34-8529-9ad9f2becf63","Type":"ContainerStarted","Data":"d952988064c1bcdd61cc1875350577be62c4b11bd861bcb4dcccd020d51dc689"}
Sep 20 00:54:26.089604 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:26.089555    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d" podStartSLOduration=2.375077744 podStartE2EDuration="5.089539863s" totalImagesPullingTime="2.714462119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:26.088421567 +0000 UTC m=+413.081697101" watchObservedRunningTime="2026-09-20 00:54:26.089539863 +0000 UTC m=+413.082815451"
Sep 20 00:54:27.581486 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:27.581451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:27.650051 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:27.650021    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:28.263867 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:28.263834    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:28.469792 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:28.469750    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:28.570188 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:28.570116    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:32.461382 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:32.461348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:32.561332 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:32.561298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:32.661041 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:32.661009    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:32.763645 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:32.763609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:33.013626 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:33.013576    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:33.867586 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:33.867551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:39.192006 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.191970    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"]
Sep 20 00:54:39.200774 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.200757    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.204217 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.204179    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bqpmn\""
Sep 20 00:54:39.205340 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.205312    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 20 00:54:39.205444 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.205352    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 20 00:54:39.205444 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.205381    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 20 00:54:39.220688 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.220663    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"]
Sep 20 00:54:39.268087 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.268056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bc9cde9-5644-47e0-a35f-a296967a8fe7-metrics-cert\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.268249 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.268093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bc9cde9-5644-47e0-a35f-a296967a8fe7-cert\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.268249 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.268121    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bc9cde9-5644-47e0-a35f-a296967a8fe7-manager-config\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.268336 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.268297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8s6\" (UniqueName: \"kubernetes.io/projected/5bc9cde9-5644-47e0-a35f-a296967a8fe7-kube-api-access-7t8s6\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.369247 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.369211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bc9cde9-5644-47e0-a35f-a296967a8fe7-manager-config\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.369406 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.369313    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8s6\" (UniqueName: \"kubernetes.io/projected/5bc9cde9-5644-47e0-a35f-a296967a8fe7-kube-api-access-7t8s6\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.369406 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.369344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bc9cde9-5644-47e0-a35f-a296967a8fe7-metrics-cert\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.369406 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.369378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bc9cde9-5644-47e0-a35f-a296967a8fe7-cert\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.369983 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.369949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bc9cde9-5644-47e0-a35f-a296967a8fe7-manager-config\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.371863 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.371841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bc9cde9-5644-47e0-a35f-a296967a8fe7-metrics-cert\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.372003 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.371980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bc9cde9-5644-47e0-a35f-a296967a8fe7-cert\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.377642 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.377617    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8s6\" (UniqueName: \"kubernetes.io/projected/5bc9cde9-5644-47e0-a35f-a296967a8fe7-kube-api-access-7t8s6\") pod \"lws-controller-manager-694bb85cb6-7hj8t\" (UID: \"5bc9cde9-5644-47e0-a35f-a296967a8fe7\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.510102 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.510074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:39.793936 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:39.793905    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"]
Sep 20 00:54:39.795575 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:54:39.795543    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc9cde9_5644_47e0_a35f_a296967a8fe7.slice/crio-0a327dee434a6bf796fc69b75d8c75a6a1e7b2abc8fc51875ab9db58dcc3b963 WatchSource:0}: Error finding container 0a327dee434a6bf796fc69b75d8c75a6a1e7b2abc8fc51875ab9db58dcc3b963: Status 404 returned error can't find the container with id 0a327dee434a6bf796fc69b75d8c75a6a1e7b2abc8fc51875ab9db58dcc3b963
Sep 20 00:54:40.131029 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:40.130940    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t" event={"ID":"5bc9cde9-5644-47e0-a35f-a296967a8fe7","Type":"ContainerStarted","Data":"0a327dee434a6bf796fc69b75d8c75a6a1e7b2abc8fc51875ab9db58dcc3b963"}
Sep 20 00:54:41.397033 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:41.396961    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:41.478275 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:41.478237    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:41.823239 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:41.823181    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:41.955462 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:41.955435    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:42.141556 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:42.141483    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t" event={"ID":"5bc9cde9-5644-47e0-a35f-a296967a8fe7","Type":"ContainerStarted","Data":"9039c5bc4e56a807c70b74895354f8bca3db2de11531145a8abc01efa323d9fe"}
Sep 20 00:54:42.141673 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:42.141581    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:42.158693 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:42.158641    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t" podStartSLOduration=1.477924188 podStartE2EDuration="3.158627126s" totalImagesPullingTime="1.680702938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:42.157638773 +0000 UTC m=+429.150914309" watchObservedRunningTime="2026-09-20 00:54:42.158627126 +0000 UTC m=+429.151902659"
Sep 20 00:54:42.691454 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:42.691418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:42.799725 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:42.799688    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:42.901245 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:42.901212    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:53.148567 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:53.148537    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-7hj8t"
Sep 20 00:54:53.252523 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:53.252482    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:53.302916 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:53.302887    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:55.099603 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:55.099565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:54:55.156143 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:54:55.156113    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:33.385115 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:33.385077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:33.491429 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:33.491389    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:47.503186 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:47.503154    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:49.904575 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:49.904529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:50.297476 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:50.297447    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:51.733509 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:51.733469    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:51.835792 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:51.835760    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:52.705159 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:52.705128    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:52.936700 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:52.936664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:53.117939 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:53.117914    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:53.696374 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:53.696346    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:54.750326 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:54.750292    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:54.850160 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:54.850129    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:55.626490 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:55.626462    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:56.928035 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:56.927990    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:57.152530 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:57.152496    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:55:59.913398 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:55:59.913360    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:00.013721 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:00.013688    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:03.799465 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:03.799419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:04.259743 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:04.259708    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:05.359752 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:05.359720    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:05.458872 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:05.458841    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:05.559928 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:05.559894    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:09.316133 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:09.316091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:09.415678 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:09.415646    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:09.469089 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:09.469063    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:13.817089 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.817054    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"]
Sep 20 00:56:13.820288 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.820269    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:13.822897 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.822874    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 20 00:56:13.823075 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.823052    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nfvhq\""
Sep 20 00:56:13.823245 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.823230    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 20 00:56:13.844020 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.843992    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"]
Sep 20 00:56:13.852233 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.852208    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj6dh\" (UniqueName: \"kubernetes.io/projected/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-kube-api-access-xj6dh\") pod \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:13.852320 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.852287    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:13.952889 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.952866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:13.952979 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.952914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj6dh\" (UniqueName: \"kubernetes.io/projected/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-kube-api-access-xj6dh\") pod \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:13.953243 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.953225    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:13.962224 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:13.962204    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj6dh\" (UniqueName: \"kubernetes.io/projected/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-kube-api-access-xj6dh\") pod \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:14.130398 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.130348    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:14.276694 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.276666    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:14.386347 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.386226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:14.404318 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.404298    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"]
Sep 20 00:56:14.406923 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:56:14.406894    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a3c330_ed55_4fc5_b1fc_0e8cf3f20edf.slice/crio-7d24142493d5c79b58ce0a3b25cf0ac3360e20ea3cfa1ea9e968bee0d6880033 WatchSource:0}: Error finding container 7d24142493d5c79b58ce0a3b25cf0ac3360e20ea3cfa1ea9e968bee0d6880033: Status 404 returned error can't find the container with id 7d24142493d5c79b58ce0a3b25cf0ac3360e20ea3cfa1ea9e968bee0d6880033
Sep 20 00:56:14.497205 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.497163    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"]
Sep 20 00:56:14.504089 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.504070    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"]
Sep 20 00:56:14.524844 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.524821    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"]
Sep 20 00:56:14.529061 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.529043    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:14.542842 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.542819    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"]
Sep 20 00:56:14.557556 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.557536    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lstbn\" (UniqueName: \"kubernetes.io/projected/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-kube-api-access-lstbn\") pod \"kuadrant-operator-controller-manager-5f685c496f-9srrz\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:14.557649 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.557592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9srrz\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:14.658657 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.658586    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lstbn\" (UniqueName: \"kubernetes.io/projected/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-kube-api-access-lstbn\") pod \"kuadrant-operator-controller-manager-5f685c496f-9srrz\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:14.658657 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.658644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9srrz\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:14.658985 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.658965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9srrz\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:14.667048 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.667024    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lstbn\" (UniqueName: \"kubernetes.io/projected/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-kube-api-access-lstbn\") pod \"kuadrant-operator-controller-manager-5f685c496f-9srrz\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:14.839140 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:14.839115    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:15.140399 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:15.140159    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"]
Sep 20 00:56:15.538087 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:15.538045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz" event={"ID":"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af","Type":"ContainerStarted","Data":"7526cd5cce91716bd425b5bb6fae8e02ab8ad39ca0ebf249a1c9c441f032b4fb"}
Sep 20 00:56:16.441111 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:16.441057    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:16.532440 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:16.532382    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:18.555033 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.554939    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6" podUID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" containerName="manager" containerID="cri-o://b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4" gracePeriod=2
Sep 20 00:56:18.556804 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.556781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz" event={"ID":"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af","Type":"ContainerStarted","Data":"997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3"}
Sep 20 00:56:18.556949 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.556934    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:18.580408 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.580345    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz" podStartSLOduration=1.365668212 podStartE2EDuration="4.580325448s" totalImagesPullingTime="3.214657236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:18.576300372 +0000 UTC m=+525.569575900" watchObservedRunningTime="2026-09-20 00:56:18.580325448 +0000 UTC m=+525.573600982"
Sep 20 00:56:18.792618 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.792596    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:18.794925 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:56:18.794900    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" is forbidden: User \"system:node:ip-10-0-134-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-159.ec2.internal' and this object" podUID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:18.896348 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.896284    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj6dh\" (UniqueName: \"kubernetes.io/projected/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-kube-api-access-xj6dh\") pod \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") "
Sep 20 00:56:18.896461 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.896359    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-extensions-socket-volume\") pod \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\" (UID: \"b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf\") "
Sep 20 00:56:18.896614 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.896591    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" (UID: "b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:56:18.898370 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.898347    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-kube-api-access-xj6dh" (OuterVolumeSpecName: "kube-api-access-xj6dh") pod "b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" (UID: "b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf"). InnerVolumeSpecName "kube-api-access-xj6dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:56:18.997216 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.997169    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-extensions-socket-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:56:18.997216 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.997214    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj6dh\" (UniqueName: \"kubernetes.io/projected/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf-kube-api-access-xj6dh\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:56:18.998487 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:18.998450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:19.098446 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:19.098415    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:19.508516 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:19.508483    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" path="/var/lib/kubelet/pods/b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf/volumes"
Sep 20 00:56:19.562373 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:19.562315    2571 generic.go:356] "Generic (PLEG): container finished" podID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" containerID="b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4" exitCode=2
Sep 20 00:56:19.562373 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:19.562359    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:19.562731 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:19.562411    2571 scope.go:117] "RemoveContainer" containerID="b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4"
Sep 20 00:56:19.567153 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:56:19.567131    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-2mpl6\" is forbidden: User \"system:node:ip-10-0-134-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-159.ec2.internal' and this object" podUID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2mpl6"
Sep 20 00:56:19.570299 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:19.570272    2571 scope.go:117] "RemoveContainer" containerID="b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4"
Sep 20 00:56:19.570558 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:56:19.570537    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4\": container with ID starting with b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4 not found: ID does not exist" containerID="b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4"
Sep 20 00:56:19.570602 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:19.570566    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4"} err="failed to get container status \"b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4\": rpc error: code = NotFound desc = could not find container \"b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4\": container with ID starting with b311d3657bd8067a18653aaa5dab7e2788d479f44aefd226cba5b752557f11e4 not found: ID does not exist"
Sep 20 00:56:24.385951 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:24.385915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:24.438697 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:24.438664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:24.787410 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:24.787373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:24.888391 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:24.888333    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:29.016597 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:29.016492    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:29.114235 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:29.114151    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:29.221944 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:29.221889    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:29.565330 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:29.565301    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:33.022293 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:33.022247    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:33.120825 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:33.120796    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:36.047030 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:36.046990    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:36.147259 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:36.147218    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:41.622297 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:41.622259    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"]
Sep 20 00:56:41.622733 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:41.622520    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz" podUID="c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" containerName="manager" containerID="cri-o://997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3" gracePeriod=10
Sep 20 00:56:41.862942 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:41.862917    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:41.962285 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:41.962218    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-extensions-socket-volume\") pod \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") "
Sep 20 00:56:41.962398 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:41.962297    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lstbn\" (UniqueName: \"kubernetes.io/projected/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-kube-api-access-lstbn\") pod \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\" (UID: \"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af\") "
Sep 20 00:56:41.962562 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:41.962534    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" (UID: "c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:56:41.964164 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:41.964145    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-kube-api-access-lstbn" (OuterVolumeSpecName: "kube-api-access-lstbn") pod "c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" (UID: "c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af"). InnerVolumeSpecName "kube-api-access-lstbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:56:42.063508 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.063487    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lstbn\" (UniqueName: \"kubernetes.io/projected/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-kube-api-access-lstbn\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:56:42.063508 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.063505    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af-extensions-socket-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:56:42.670072 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.670037    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" containerID="997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3" exitCode=0
Sep 20 00:56:42.670520 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.670082    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"
Sep 20 00:56:42.670520 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.670090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz" event={"ID":"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af","Type":"ContainerDied","Data":"997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3"}
Sep 20 00:56:42.670520 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.670128    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz" event={"ID":"c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af","Type":"ContainerDied","Data":"7526cd5cce91716bd425b5bb6fae8e02ab8ad39ca0ebf249a1c9c441f032b4fb"}
Sep 20 00:56:42.670520 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.670148    2571 scope.go:117] "RemoveContainer" containerID="997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3"
Sep 20 00:56:42.678276 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.678250    2571 scope.go:117] "RemoveContainer" containerID="997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3"
Sep 20 00:56:42.678535 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:56:42.678516    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3\": container with ID starting with 997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3 not found: ID does not exist" containerID="997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3"
Sep 20 00:56:42.678592 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.678543    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3"} err="failed to get container status \"997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3\": rpc error: code = NotFound desc = could not find container \"997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3\": container with ID starting with 997aa15cdb30e28653880348e205326a68d878ed2bb09c3e03372676311916d3 not found: ID does not exist"
Sep 20 00:56:42.698301 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.698277    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"]
Sep 20 00:56:42.702595 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:42.702575    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9srrz"]
Sep 20 00:56:43.508459 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:43.508434    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" path="/var/lib/kubelet/pods/c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af/volumes"
Sep 20 00:56:45.867871 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.867837    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"]
Sep 20 00:56:45.868289 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.868159    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" containerName="manager"
Sep 20 00:56:45.868289 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.868172    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" containerName="manager"
Sep 20 00:56:45.868289 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.868187    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" containerName="manager"
Sep 20 00:56:45.868289 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.868209    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" containerName="manager"
Sep 20 00:56:45.868289 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.868269    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b4ba76-ba5e-4bf9-a3ee-c45ff44ad0af" containerName="manager"
Sep 20 00:56:45.868289 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.868277    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2a3c330-ed55-4fc5-b1fc-0e8cf3f20edf" containerName="manager"
Sep 20 00:56:45.902232 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.902185    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:45.909872 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.909847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"]
Sep 20 00:56:45.909995 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.909934    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.913063 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.913043    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-thchv\""
Sep 20 00:56:45.913166 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.913083    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 20 00:56:45.991260 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991353 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991270    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx9m7\" (UniqueName: \"kubernetes.io/projected/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-kube-api-access-qx9m7\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991353 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991301    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991353 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991455 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991455 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991455 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991446    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991547 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:45.991547 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:45.991512    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.092672 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.092769 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092682    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.092769 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.092769 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.092939 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.092939 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093040 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092938    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx9m7\" (UniqueName: \"kubernetes.io/projected/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-kube-api-access-qx9m7\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093040 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.092991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093040 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.093016    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093178 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.093016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093554 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.093531    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093638 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.093571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093638 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.093575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.093751 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.093665    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.095126 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.095093    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.095241 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.095231    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.100967 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.100945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.101145 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.101121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx9m7\" (UniqueName: \"kubernetes.io/projected/2a6b5bc6-2c3f-4cf3-b25e-1064efece277-kube-api-access-qx9m7\") pod \"maas-default-gateway-openshift-default-5ccb968c66-b6lkl\" (UID: \"2a6b5bc6-2c3f-4cf3-b25e-1064efece277\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.165441 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.165378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:56:46.219372 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.219349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:46.511022 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.510999    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"]
Sep 20 00:56:46.513233 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:56:46.513208    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6b5bc6_2c3f_4cf3_b25e_1064efece277.slice/crio-f3dc01b778b606d631b9658a4c9d850daccd9941dc769282e109e8b3b3f865aa WatchSource:0}: Error finding container f3dc01b778b606d631b9658a4c9d850daccd9941dc769282e109e8b3b3f865aa: Status 404 returned error can't find the container with id f3dc01b778b606d631b9658a4c9d850daccd9941dc769282e109e8b3b3f865aa
Sep 20 00:56:46.688168 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:46.688135    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" event={"ID":"2a6b5bc6-2c3f-4cf3-b25e-1064efece277","Type":"ContainerStarted","Data":"f3dc01b778b606d631b9658a4c9d850daccd9941dc769282e109e8b3b3f865aa"}
Sep 20 00:56:49.713947 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:49.713907    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 00:56:49.714281 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:49.713980    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 00:56:49.714281 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:49.714011    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 00:56:50.708448 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:50.708407    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" event={"ID":"2a6b5bc6-2c3f-4cf3-b25e-1064efece277","Type":"ContainerStarted","Data":"8d547d46fd94d4204ea24ee145912400d2cfcd4904d529b5a90c6de11d849282"}
Sep 20 00:56:50.728670 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:50.728619    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" podStartSLOduration=2.530199221 podStartE2EDuration="5.728602665s" totalImagesPullingTime="3.198403444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:56:50.727255809 +0000 UTC m=+557.720531343" watchObservedRunningTime="2026-09-20 00:56:50.728602665 +0000 UTC m=+557.721878197"
Sep 20 00:56:51.220011 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:51.219977    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:51.225311 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:51.225284    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:51.712572 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:51.712536    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:56:51.713522 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:56:51.713498    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:57:00.009118 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.009085    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:00.121263 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.121226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:00.216797 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.216759    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:00.434715 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.434640    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:57:00.437780 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.437762    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.440480 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.440456    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 20 00:57:00.440609 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.440581    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 20 00:57:00.440609 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.440596    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5h6tm\""
Sep 20 00:57:00.441445 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.441429    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 20 00:57:00.445641 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.445617    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:57:00.471508 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.471485    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:57:00.603632 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.603606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmm9\" (UniqueName: \"kubernetes.io/projected/2bb07b8d-a306-49b8-8930-7e7be3bdc431-kube-api-access-6fmm9\") pod \"limitador-limitador-84994f7ffc-8ff9d\" (UID: \"2bb07b8d-a306-49b8-8930-7e7be3bdc431\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.603742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.603661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bb07b8d-a306-49b8-8930-7e7be3bdc431-config-file\") pod \"limitador-limitador-84994f7ffc-8ff9d\" (UID: \"2bb07b8d-a306-49b8-8930-7e7be3bdc431\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.704141 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.704078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmm9\" (UniqueName: \"kubernetes.io/projected/2bb07b8d-a306-49b8-8930-7e7be3bdc431-kube-api-access-6fmm9\") pod \"limitador-limitador-84994f7ffc-8ff9d\" (UID: \"2bb07b8d-a306-49b8-8930-7e7be3bdc431\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.704254 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.704139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bb07b8d-a306-49b8-8930-7e7be3bdc431-config-file\") pod \"limitador-limitador-84994f7ffc-8ff9d\" (UID: \"2bb07b8d-a306-49b8-8930-7e7be3bdc431\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.704817 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.704796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bb07b8d-a306-49b8-8930-7e7be3bdc431-config-file\") pod \"limitador-limitador-84994f7ffc-8ff9d\" (UID: \"2bb07b8d-a306-49b8-8930-7e7be3bdc431\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.715917 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.715886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmm9\" (UniqueName: \"kubernetes.io/projected/2bb07b8d-a306-49b8-8930-7e7be3bdc431-kube-api-access-6fmm9\") pod \"limitador-limitador-84994f7ffc-8ff9d\" (UID: \"2bb07b8d-a306-49b8-8930-7e7be3bdc431\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.748816 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.748790    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:00.873461 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.873423    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:00.975399 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.975332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:00.984125 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.984100    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-vl6p7"]
Sep 20 00:57:00.987444 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.987429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-vl6p7"
Sep 20 00:57:00.989742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.989722    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jzqpq\""
Sep 20 00:57:00.992577 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:00.992557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-vl6p7"]
Sep 20 00:57:01.019144 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.019121    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:57:01.022168 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:57:01.022143    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb07b8d_a306_49b8_8930_7e7be3bdc431.slice/crio-4640aa958691e2b91c1cff581f8502e8262b552631f7f4fce1c9f5749eead6f4 WatchSource:0}: Error finding container 4640aa958691e2b91c1cff581f8502e8262b552631f7f4fce1c9f5749eead6f4: Status 404 returned error can't find the container with id 4640aa958691e2b91c1cff581f8502e8262b552631f7f4fce1c9f5749eead6f4
Sep 20 00:57:01.106771 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.106751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmtp\" (UniqueName: \"kubernetes.io/projected/204788c9-a808-4333-8165-161df03c803d-kube-api-access-vhmtp\") pod \"authorino-59c974bd48-vl6p7\" (UID: \"204788c9-a808-4333-8165-161df03c803d\") " pod="kuadrant-system/authorino-59c974bd48-vl6p7"
Sep 20 00:57:01.207493 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.207473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmtp\" (UniqueName: \"kubernetes.io/projected/204788c9-a808-4333-8165-161df03c803d-kube-api-access-vhmtp\") pod \"authorino-59c974bd48-vl6p7\" (UID: \"204788c9-a808-4333-8165-161df03c803d\") " pod="kuadrant-system/authorino-59c974bd48-vl6p7"
Sep 20 00:57:01.215566 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.215542    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmtp\" (UniqueName: \"kubernetes.io/projected/204788c9-a808-4333-8165-161df03c803d-kube-api-access-vhmtp\") pod \"authorino-59c974bd48-vl6p7\" (UID: \"204788c9-a808-4333-8165-161df03c803d\") " pod="kuadrant-system/authorino-59c974bd48-vl6p7"
Sep 20 00:57:01.296989 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.296965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-vl6p7"
Sep 20 00:57:01.563686 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.563664    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-vl6p7"]
Sep 20 00:57:01.566126 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:57:01.566094    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod204788c9_a808_4333_8165_161df03c803d.slice/crio-eec917264d5f876bacf958ab5c19546fcb2e9de93335b5b1ccead194a0c56329 WatchSource:0}: Error finding container eec917264d5f876bacf958ab5c19546fcb2e9de93335b5b1ccead194a0c56329: Status 404 returned error can't find the container with id eec917264d5f876bacf958ab5c19546fcb2e9de93335b5b1ccead194a0c56329
Sep 20 00:57:01.759042 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.759014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d" event={"ID":"2bb07b8d-a306-49b8-8930-7e7be3bdc431","Type":"ContainerStarted","Data":"4640aa958691e2b91c1cff581f8502e8262b552631f7f4fce1c9f5749eead6f4"}
Sep 20 00:57:01.760327 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:01.760303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-vl6p7" event={"ID":"204788c9-a808-4333-8165-161df03c803d","Type":"ContainerStarted","Data":"eec917264d5f876bacf958ab5c19546fcb2e9de93335b5b1ccead194a0c56329"}
Sep 20 00:57:02.766382 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:02.766345    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d" event={"ID":"2bb07b8d-a306-49b8-8930-7e7be3bdc431","Type":"ContainerStarted","Data":"1e227a02fff58f184a9cb58560d46024bdef2f726d64a08c7dbeb4edc250b7f7"}
Sep 20 00:57:02.766805 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:02.766413    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:03.772390 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:03.772330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-vl6p7" event={"ID":"204788c9-a808-4333-8165-161df03c803d","Type":"ContainerStarted","Data":"629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68"}
Sep 20 00:57:03.790232 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:03.790159    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d" podStartSLOduration=2.569154385 podStartE2EDuration="3.790142126s" totalImagesPullingTime="1.220987741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:02.782080032 +0000 UTC m=+569.775355589" watchObservedRunningTime="2026-09-20 00:57:03.790142126 +0000 UTC m=+570.783417707"
Sep 20 00:57:03.790720 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:03.790695    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-vl6p7" podStartSLOduration=2.106087547 podStartE2EDuration="3.790687829s" totalImagesPullingTime="1.684600282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:57:03.789119133 +0000 UTC m=+570.782394667" watchObservedRunningTime="2026-09-20 00:57:03.790687829 +0000 UTC m=+570.783963359"
Sep 20 00:57:13.773868 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:13.773826    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"
Sep 20 00:57:18.059017 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:18.058975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:18.158828 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:18.158782    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:18.524913 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:18.524880    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:27.039614 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:27.039573    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:27.140258 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:27.140224    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:31.214674 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:31.214625    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:31.459934 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:31.459895    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:32.967328 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:32.967287    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-vl6p7"]
Sep 20 00:57:32.967725 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:32.967482    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-vl6p7" podUID="204788c9-a808-4333-8165-161df03c803d" containerName="authorino" containerID="cri-o://629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68" gracePeriod=30
Sep 20 00:57:33.209694 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.209667    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-vl6p7"
Sep 20 00:57:33.231292 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.231232    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhmtp\" (UniqueName: \"kubernetes.io/projected/204788c9-a808-4333-8165-161df03c803d-kube-api-access-vhmtp\") pod \"204788c9-a808-4333-8165-161df03c803d\" (UID: \"204788c9-a808-4333-8165-161df03c803d\") "
Sep 20 00:57:33.233273 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.233250    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204788c9-a808-4333-8165-161df03c803d-kube-api-access-vhmtp" (OuterVolumeSpecName: "kube-api-access-vhmtp") pod "204788c9-a808-4333-8165-161df03c803d" (UID: "204788c9-a808-4333-8165-161df03c803d"). InnerVolumeSpecName "kube-api-access-vhmtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:57:33.331979 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.331946    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhmtp\" (UniqueName: \"kubernetes.io/projected/204788c9-a808-4333-8165-161df03c803d-kube-api-access-vhmtp\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 00:57:33.910938 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.910867    2571 generic.go:356] "Generic (PLEG): container finished" podID="204788c9-a808-4333-8165-161df03c803d" containerID="629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68" exitCode=0
Sep 20 00:57:33.910938 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.910909    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-vl6p7"
Sep 20 00:57:33.910938 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.910936    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-vl6p7" event={"ID":"204788c9-a808-4333-8165-161df03c803d","Type":"ContainerDied","Data":"629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68"}
Sep 20 00:57:33.911114 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.910966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-vl6p7" event={"ID":"204788c9-a808-4333-8165-161df03c803d","Type":"ContainerDied","Data":"eec917264d5f876bacf958ab5c19546fcb2e9de93335b5b1ccead194a0c56329"}
Sep 20 00:57:33.911114 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.910981    2571 scope.go:117] "RemoveContainer" containerID="629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68"
Sep 20 00:57:33.918666 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.918638    2571 scope.go:117] "RemoveContainer" containerID="629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68"
Sep 20 00:57:33.919027 ip-10-0-134-159 kubenswrapper[2571]: E0920 00:57:33.918990    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68\": container with ID starting with 629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68 not found: ID does not exist" containerID="629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68"
Sep 20 00:57:33.919146 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.919035    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68"} err="failed to get container status \"629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68\": rpc error: code = NotFound desc = could not find container \"629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68\": container with ID starting with 629517a762cb0bfdb07af6b4d456b6fa15db0b94208c0c1032feafc96a5a4f68 not found: ID does not exist"
Sep 20 00:57:33.926862 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.926837    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-vl6p7"]
Sep 20 00:57:33.930473 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:33.930451    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-vl6p7"]
Sep 20 00:57:35.507964 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:35.507924    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204788c9-a808-4333-8165-161df03c803d" path="/var/lib/kubelet/pods/204788c9-a808-4333-8165-161df03c803d/volumes"
Sep 20 00:57:37.559568 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:37.559534    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:37.639520 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:37.639492    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:37.698756 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:37.698728    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:37.758185 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:37.758153    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:41.028816 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:41.028779    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:57:41.166786 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:57:41.166757    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:11.432880 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:11.432842    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:12.650481 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:12.650448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:12.840477 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:12.840441    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:12.941336 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:12.941267    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:13.046637 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:13.046609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:13.250801 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:13.250773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:13.540400 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:13.540332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:13.638651 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:13.638624    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:13.754064 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:13.754035    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:58:22.402401 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:22.401753    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-b6lkl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": read tcp 10.133.0.2:34118->10.133.0.24:15021: read: connection reset by peer" start-of-body=
Sep 20 00:58:22.402401 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:22.401833    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" podUID="2a6b5bc6-2c3f-4cf3-b25e-1064efece277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": read tcp 10.133.0.2:34118->10.133.0.24:15021: read: connection reset by peer"
Sep 20 00:58:23.127388 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.127355    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a6b5bc6-2c3f-4cf3-b25e-1064efece277" containerID="8d547d46fd94d4204ea24ee145912400d2cfcd4904d529b5a90c6de11d849282" exitCode=0
Sep 20 00:58:23.127520 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.127414    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" event={"ID":"2a6b5bc6-2c3f-4cf3-b25e-1064efece277","Type":"ContainerDied","Data":"8d547d46fd94d4204ea24ee145912400d2cfcd4904d529b5a90c6de11d849282"}
Sep 20 00:58:23.127747 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.127732    2571 scope.go:117] "RemoveContainer" containerID="8d547d46fd94d4204ea24ee145912400d2cfcd4904d529b5a90c6de11d849282"
Sep 20 00:58:23.128734 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.128697    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 00:58:23.128797 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.128782    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 00:58:23.128837 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.128823    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 00:58:23.754092 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.754054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:23.847090 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:23.847047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:24.134313 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:24.134225    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" event={"ID":"2a6b5bc6-2c3f-4cf3-b25e-1064efece277","Type":"ContainerStarted","Data":"7a4e5ce1a6e198a0d95030490eaa4174f37cbe3c450fcc0517628edfb901828d"}
Sep 20 00:58:24.220178 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:24.220140    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:58:24.220368 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:24.220345    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-b6lkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Sep 20 00:58:24.220409 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:24.220392    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" podUID="2a6b5bc6-2c3f-4cf3-b25e-1064efece277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Sep 20 00:58:25.220343 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:25.220309    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-b6lkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Sep 20 00:58:25.220692 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:25.220359    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" podUID="2a6b5bc6-2c3f-4cf3-b25e-1064efece277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Sep 20 00:58:26.220120 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:26.220082    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-b6lkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Sep 20 00:58:26.220320 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:26.220139    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" podUID="2a6b5bc6-2c3f-4cf3-b25e-1064efece277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Sep 20 00:58:27.220532 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:27.220494    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-b6lkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Sep 20 00:58:27.220994 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:27.220556    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" podUID="2a6b5bc6-2c3f-4cf3-b25e-1064efece277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Sep 20 00:58:28.220350 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:28.220312    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-b6lkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Sep 20 00:58:28.220529 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:28.220366    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl" podUID="2a6b5bc6-2c3f-4cf3-b25e-1064efece277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Sep 20 00:58:29.222873 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:29.222842    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:58:29.223261 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:29.223098    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:58:29.223825 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:29.223808    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl"
Sep 20 00:58:30.236000 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:30.235968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:30.724824 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:30.724787    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:58:35.520293 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:35.520251    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:36.249739 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:36.249697    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:58:39.926629 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:39.926578    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:40.994594 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:40.994563    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:46.598690 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.598657    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"]
Sep 20 00:58:46.599093 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.598968    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204788c9-a808-4333-8165-161df03c803d" containerName="authorino"
Sep 20 00:58:46.599093 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.598979    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="204788c9-a808-4333-8165-161df03c803d" containerName="authorino"
Sep 20 00:58:46.599093 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.599036    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="204788c9-a808-4333-8165-161df03c803d" containerName="authorino"
Sep 20 00:58:46.603236 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.603215    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.605626 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.605603    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 20 00:58:46.606737 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.606719    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 20 00:58:46.606835 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.606816    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 20 00:58:46.606888 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.606825    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dtt4r\""
Sep 20 00:58:46.615080 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.615053    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"]
Sep 20 00:58:46.618677 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.618622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:46.673103 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.673079    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.673204 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.673109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9729429-174d-47f5-bd88-2086f22674fe-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.673204 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.673133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f82zn\" (UniqueName: \"kubernetes.io/projected/c9729429-174d-47f5-bd88-2086f22674fe-kube-api-access-f82zn\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.673204 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.673189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.673316 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.673220    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.673316 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.673289    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.773784 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.773758    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.773868 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.773802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.773868 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.773849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.773946 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.773880    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9729429-174d-47f5-bd88-2086f22674fe-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.774028 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.774007    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f82zn\" (UniqueName: \"kubernetes.io/projected/c9729429-174d-47f5-bd88-2086f22674fe-kube-api-access-f82zn\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.774089 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.774071    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.774357 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.774327    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.774457 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.774381    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.774457 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.774409    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.776090 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.776069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9729429-174d-47f5-bd88-2086f22674fe-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.776350 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.776333    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9729429-174d-47f5-bd88-2086f22674fe-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.781878 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.781857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f82zn\" (UniqueName: \"kubernetes.io/projected/c9729429-174d-47f5-bd88-2086f22674fe-kube-api-access-f82zn\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-274md\" (UID: \"c9729429-174d-47f5-bd88-2086f22674fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:46.912858 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:46.912802    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:47.184553 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:47.184530    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"]
Sep 20 00:58:47.186809 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:58:47.186755    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9729429_174d_47f5_bd88_2086f22674fe.slice/crio-bc94c9718ebe1b00d79411b5dfe51385933ef1720e2a094921d32f5ba5b70c45 WatchSource:0}: Error finding container bc94c9718ebe1b00d79411b5dfe51385933ef1720e2a094921d32f5ba5b70c45: Status 404 returned error can't find the container with id bc94c9718ebe1b00d79411b5dfe51385933ef1720e2a094921d32f5ba5b70c45
Sep 20 00:58:47.188178 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:47.188159    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:58:47.243934 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:47.243904    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md" event={"ID":"c9729429-174d-47f5-bd88-2086f22674fe","Type":"ContainerStarted","Data":"bc94c9718ebe1b00d79411b5dfe51385933ef1720e2a094921d32f5ba5b70c45"}
Sep 20 00:58:47.601162 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:47.601126    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:58:48.249764 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:48.249740    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md" event={"ID":"c9729429-174d-47f5-bd88-2086f22674fe","Type":"ContainerStarted","Data":"b08f1053b0e9afa82794439146ea6a90b86d1373e1d80d71052cd503e1eef679"}
Sep 20 00:58:48.269271 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:48.269227    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md" podStartSLOduration=1.317376409 podStartE2EDuration="2.269212787s" totalImagesPullingTime="951.836378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:58:48.267381597 +0000 UTC m=+675.260657129" watchObservedRunningTime="2026-09-20 00:58:48.269212787 +0000 UTC m=+675.262488312"
Sep 20 00:58:56.913208 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:56.913158    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:56.913648 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:56.913231    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:56.925620 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:56.925590    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:57.306259 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:57.306230    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-274md"
Sep 20 00:58:58.027345 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:58.027307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:58:59.403026 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:58:59.402982    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:59:01.990669 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:01.990628    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:59:04.196715 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:04.196672    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:59:07.924135 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:07.924101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:59:09.302752 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:09.302711    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:59:13.198500 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.198459    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"]
Sep 20 00:59:13.202049 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.202027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.204436 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.204414    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 20 00:59:13.210223 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.210176    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"]
Sep 20 00:59:13.274091 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.274064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.274251 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.274104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dldj\" (UniqueName: \"kubernetes.io/projected/54fa31cf-4610-4010-8cbe-f55b1747e0d9-kube-api-access-9dldj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.274251 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.274137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.274400 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.274261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54fa31cf-4610-4010-8cbe-f55b1747e0d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.274400 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.274358    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.274496 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.274419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.321917 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.321887    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 00:59:13.374742 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.374714    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.374850 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.374750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dldj\" (UniqueName: \"kubernetes.io/projected/54fa31cf-4610-4010-8cbe-f55b1747e0d9-kube-api-access-9dldj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.374850 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.374783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.374850 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.374815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54fa31cf-4610-4010-8cbe-f55b1747e0d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.375003 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.374851    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.375003 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.374876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.375213 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.375174    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.375277 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.375216    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.375277 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.375174    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.377090 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.377069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54fa31cf-4610-4010-8cbe-f55b1747e0d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.377476 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.377454    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54fa31cf-4610-4010-8cbe-f55b1747e0d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.381922 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.381899    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dldj\" (UniqueName: \"kubernetes.io/projected/54fa31cf-4610-4010-8cbe-f55b1747e0d9-kube-api-access-9dldj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c\" (UID: \"54fa31cf-4610-4010-8cbe-f55b1747e0d9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.512748 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.512726    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:13.782095 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:13.782072    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"]
Sep 20 00:59:13.783818 ip-10-0-134-159 kubenswrapper[2571]: W0920 00:59:13.783791    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54fa31cf_4610_4010_8cbe_f55b1747e0d9.slice/crio-d0043ddc473fed5fc9248a55411df02b8b97b3c9c4a7e24f472acb8a19aacb67 WatchSource:0}: Error finding container d0043ddc473fed5fc9248a55411df02b8b97b3c9c4a7e24f472acb8a19aacb67: Status 404 returned error can't find the container with id d0043ddc473fed5fc9248a55411df02b8b97b3c9c4a7e24f472acb8a19aacb67
Sep 20 00:59:14.371425 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:14.371386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c" event={"ID":"54fa31cf-4610-4010-8cbe-f55b1747e0d9","Type":"ContainerStarted","Data":"49471d0e83cf617f9919db2aaebe2a955097525672409460e4b58d4bcd8f515a"}
Sep 20 00:59:14.371776 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:14.371438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c" event={"ID":"54fa31cf-4610-4010-8cbe-f55b1747e0d9","Type":"ContainerStarted","Data":"d0043ddc473fed5fc9248a55411df02b8b97b3c9c4a7e24f472acb8a19aacb67"}
Sep 20 00:59:14.387489 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:14.387425    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c" podStartSLOduration=1.200117098 podStartE2EDuration="1.387405401s" totalImagesPullingTime="187.288303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:59:14.387163919 +0000 UTC m=+701.380439451" watchObservedRunningTime="2026-09-20 00:59:14.387405401 +0000 UTC m=+701.380680935"
Sep 20 00:59:16.397775 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:16.397741    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 00:59:23.512943 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:23.512907    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:23.512943 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:23.512949    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:23.525369 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:23.525342    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 00:59:24.429125 ip-10-0-134-159 kubenswrapper[2571]: I0920 00:59:24.429100    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c"
Sep 20 01:00:05.354058 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:05.354010    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:05.413480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:05.413444    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:29.630858 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.630814    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f66cd9df6-9gvgv"]
Sep 20 01:00:29.634074 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.634046    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:29.638294 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.638267    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jzqpq\""
Sep 20 01:00:29.638440 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.638320    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 20 01:00:29.642065 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.642032    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f66cd9df6-9gvgv"]
Sep 20 01:00:29.737258 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.737231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94385181-f298-4c85-9dd0-5fd4ab760c5f-tls-cert\") pod \"authorino-7f66cd9df6-9gvgv\" (UID: \"94385181-f298-4c85-9dd0-5fd4ab760c5f\") " pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:29.737385 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.737288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9qf\" (UniqueName: \"kubernetes.io/projected/94385181-f298-4c85-9dd0-5fd4ab760c5f-kube-api-access-kc9qf\") pod \"authorino-7f66cd9df6-9gvgv\" (UID: \"94385181-f298-4c85-9dd0-5fd4ab760c5f\") " pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:29.838688 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.838653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94385181-f298-4c85-9dd0-5fd4ab760c5f-tls-cert\") pod \"authorino-7f66cd9df6-9gvgv\" (UID: \"94385181-f298-4c85-9dd0-5fd4ab760c5f\") " pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:29.838804 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.838712    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9qf\" (UniqueName: \"kubernetes.io/projected/94385181-f298-4c85-9dd0-5fd4ab760c5f-kube-api-access-kc9qf\") pod \"authorino-7f66cd9df6-9gvgv\" (UID: \"94385181-f298-4c85-9dd0-5fd4ab760c5f\") " pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:29.841143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.841114    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94385181-f298-4c85-9dd0-5fd4ab760c5f-tls-cert\") pod \"authorino-7f66cd9df6-9gvgv\" (UID: \"94385181-f298-4c85-9dd0-5fd4ab760c5f\") " pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:29.846521 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.846493    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9qf\" (UniqueName: \"kubernetes.io/projected/94385181-f298-4c85-9dd0-5fd4ab760c5f-kube-api-access-kc9qf\") pod \"authorino-7f66cd9df6-9gvgv\" (UID: \"94385181-f298-4c85-9dd0-5fd4ab760c5f\") " pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:29.946295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:29.946238    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f66cd9df6-9gvgv"
Sep 20 01:00:30.214612 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:30.214586    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f66cd9df6-9gvgv"]
Sep 20 01:00:30.217154 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:00:30.217122    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94385181_f298_4c85_9dd0_5fd4ab760c5f.slice/crio-fc7f381fefec49b43235304e59e8a716889577a0259110737ac28381cdcb1a61 WatchSource:0}: Error finding container fc7f381fefec49b43235304e59e8a716889577a0259110737ac28381cdcb1a61: Status 404 returned error can't find the container with id fc7f381fefec49b43235304e59e8a716889577a0259110737ac28381cdcb1a61
Sep 20 01:00:30.729914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:30.729875    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f66cd9df6-9gvgv" event={"ID":"94385181-f298-4c85-9dd0-5fd4ab760c5f","Type":"ContainerStarted","Data":"fc7f381fefec49b43235304e59e8a716889577a0259110737ac28381cdcb1a61"}
Sep 20 01:00:31.736839 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:31.736805    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f66cd9df6-9gvgv" event={"ID":"94385181-f298-4c85-9dd0-5fd4ab760c5f","Type":"ContainerStarted","Data":"1ad99fab7e455ef17bc6ab22c9283aa4513bac8148ba9ce08bca95aa8e413592"}
Sep 20 01:00:31.754107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:31.753974    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f66cd9df6-9gvgv" podStartSLOduration=1.800511848 podStartE2EDuration="2.753954207s" totalImagesPullingTime="953.442359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:31.753421726 +0000 UTC m=+778.746697259" watchObservedRunningTime="2026-09-20 01:00:31.753954207 +0000 UTC m=+778.747229740"
Sep 20 01:00:32.345573 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:32.345538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:32.441000 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:32.440969    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:33.467370 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:33.467315    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:33.565481 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:33.565450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:50.704296 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:50.704250    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:50.808738 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:50.808703    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:50.906479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:50.906436    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:51.044817 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.044778    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:51.088994 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.088963    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"]
Sep 20 01:00:51.093012 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.092989    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.095721 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.095701    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-e2e8bc-openshift-default-dockercfg-h4hcn\""
Sep 20 01:00:51.108603 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.108581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"]
Sep 20 01:00:51.133867 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.133840    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203309    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-certs\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203358    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-podinfo\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-envoy\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-credential-socket\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203479    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfgps\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-kube-api-access-kfgps\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-token\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istiod-ca-cert\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-socket\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.203802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.203661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-data\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.215262 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.215238    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:51.276847 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.276800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:51.304914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.304836    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-data\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.304914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.304898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-certs\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.304932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-podinfo\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.304967    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-envoy\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305008    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-credential-socket\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfgps\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-kube-api-access-kfgps\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305071    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-token\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istiod-ca-cert\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-socket\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-data\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.305689 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305647    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-certs\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.306276 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-credential-socket\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.306276 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.305880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-socket\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.306276 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.306237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istiod-ca-cert\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.307733 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.307714    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-podinfo\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.308042 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.308023    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-envoy\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.313910 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.313880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-token\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.314625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.314603    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfgps\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-kube-api-access-kfgps\") pod \"e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") " pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.378360 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.378314    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:51.403862 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.403836    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:51.620301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.620223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:51.683547 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.683518    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"]
Sep 20 01:00:51.686829 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:00:51.686796    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c14a0c_ad1f_4ca5_b61b_cf1069c6b55e.slice/crio-22f97c214ca86a1b48938ba519798a00feb5a297f25226ed03231838f6704f12 WatchSource:0}: Error finding container 22f97c214ca86a1b48938ba519798a00feb5a297f25226ed03231838f6704f12: Status 404 returned error can't find the container with id 22f97c214ca86a1b48938ba519798a00feb5a297f25226ed03231838f6704f12
Sep 20 01:00:51.688975 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.688939    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:00:51.689050 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.689003    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:00:51.689050 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.689033    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:00:51.830669 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.830635    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" event={"ID":"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e","Type":"ContainerStarted","Data":"b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c"}
Sep 20 01:00:51.831045 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.830687    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" event={"ID":"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e","Type":"ContainerStarted","Data":"22f97c214ca86a1b48938ba519798a00feb5a297f25226ed03231838f6704f12"}
Sep 20 01:00:51.851134 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:51.851084    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podStartSLOduration=0.851067745 podStartE2EDuration="851.067745ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:51.849813715 +0000 UTC m=+798.843089248" watchObservedRunningTime="2026-09-20 01:00:51.851067745 +0000 UTC m=+798.844343275"
Sep 20 01:00:52.124319 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:52.124284    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:52.220671 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:52.220641    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:52.404855 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:52.404792    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:52.410073 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:52.410053    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:52.626975 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:52.626948    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:52.835412 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:52.835386    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:52.836070 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:52.836054    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:00:53.828564 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:53.828532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:53.923001 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:53.922947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:54.242312 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:54.242227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:54.343622 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:54.343589    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:54.451404 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:54.451376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:54.593412 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:54.593385    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:54.719994 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:54.719960    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:00:55.059661 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:55.059614    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:55.153823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:55.153768    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:55.533050 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:55.533001    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:55.636624 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:55.636588    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:55.728487 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:55.728458    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:56.168808 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.168778    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:56.240626 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.240589    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:56.381440 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.381405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:56.655863 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.655823    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:56.733713 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.733671    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:56.765853 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.765825    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"]
Sep 20 01:00:56.769187 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.769172    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:56.771773 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.771750    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-4e301e\""
Sep 20 01:00:56.771875 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.771848    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-4e301e-dockercfg-x5zwd\""
Sep 20 01:00:56.781235 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.781187    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"]
Sep 20 01:00:56.854692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.854666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw58m\" (UniqueName: \"kubernetes.io/projected/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-kube-api-access-jw58m\") pod \"payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:56.854805 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.854783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:56.956185 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.956112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw58m\" (UniqueName: \"kubernetes.io/projected/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-kube-api-access-jw58m\") pod \"payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:56.956330 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.956223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:56.956861 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.956842    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:56.964797 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:56.964766    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw58m\" (UniqueName: \"kubernetes.io/projected/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-kube-api-access-jw58m\") pod \"payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:57.079809 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:57.079781    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:57.261358 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:57.261272    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:57.324126 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:57.324098    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:57.352978 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:57.352957    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"]
Sep 20 01:00:57.355440 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:00:57.355416    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e858225_8d59_44ce_83a7_dc1d9a7f4b9a.slice/crio-6a63f5b742187c8e270fd37a03531c13b5e51a35f693f02534251ed1304e2236 WatchSource:0}: Error finding container 6a63f5b742187c8e270fd37a03531c13b5e51a35f693f02534251ed1304e2236: Status 404 returned error can't find the container with id 6a63f5b742187c8e270fd37a03531c13b5e51a35f693f02534251ed1304e2236
Sep 20 01:00:57.857366 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:57.857328    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:57.860748 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:57.860717    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p" event={"ID":"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a","Type":"ContainerStarted","Data":"6a63f5b742187c8e270fd37a03531c13b5e51a35f693f02534251ed1304e2236"}
Sep 20 01:00:57.955229 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:57.955174    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:58.031219 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.031171    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"]
Sep 20 01:00:58.035475 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.035453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.037957 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.037937    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-2fd525\""
Sep 20 01:00:58.038041 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.037978    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-2fd525-dockercfg-cxlt5\""
Sep 20 01:00:58.044766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.044744    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"]
Sep 20 01:00:58.166684 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.166606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/188c387e-0a14-4d36-b958-aec8516bcc46-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.166684 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.166659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qcfp\" (UniqueName: \"kubernetes.io/projected/188c387e-0a14-4d36-b958-aec8516bcc46-kube-api-access-8qcfp\") pod \"payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.267135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.267080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/188c387e-0a14-4d36-b958-aec8516bcc46-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.268153 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.267210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qcfp\" (UniqueName: \"kubernetes.io/projected/188c387e-0a14-4d36-b958-aec8516bcc46-kube-api-access-8qcfp\") pod \"payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.268153 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.268058    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/188c387e-0a14-4d36-b958-aec8516bcc46-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.275697 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.275664    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qcfp\" (UniqueName: \"kubernetes.io/projected/188c387e-0a14-4d36-b958-aec8516bcc46-kube-api-access-8qcfp\") pod \"payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.335664 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.335641    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:58.346886 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.346860    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:58.637078 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.636981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"]
Sep 20 01:00:58.853886 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:00:58.853855    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188c387e_0a14_4d36_b958_aec8516bcc46.slice/crio-5d808d0002a9dff4a6f3d48726aff0412baf4661a440a2c38c99067f78f05ca8 WatchSource:0}: Error finding container 5d808d0002a9dff4a6f3d48726aff0412baf4661a440a2c38c99067f78f05ca8: Status 404 returned error can't find the container with id 5d808d0002a9dff4a6f3d48726aff0412baf4661a440a2c38c99067f78f05ca8
Sep 20 01:00:58.867224 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:58.867174    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj" event={"ID":"188c387e-0a14-4d36-b958-aec8516bcc46","Type":"ContainerStarted","Data":"5d808d0002a9dff4a6f3d48726aff0412baf4661a440a2c38c99067f78f05ca8"}
Sep 20 01:00:59.273229 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.273149    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:59.372028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.371998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:59.471386 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.471355    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:59.579322 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.579240    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"]
Sep 20 01:00:59.581953 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.581931    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.585066 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.585046    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-173fde-openshift-default-dockercfg-rg4bb\""
Sep 20 01:00:59.605158 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.602493    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"]
Sep 20 01:00:59.614316 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.614286    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:59.681652 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-socket\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.681786 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681662    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-certs\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.681786 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psd4d\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-kube-api-access-psd4d\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.681786 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-envoy\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.681786 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681775    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-token\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.681961 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istiod-ca-cert\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.681961 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-credential-socket\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.682055 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.681972    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-data\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.682055 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.682030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-podinfo\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.775531 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.775339    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"]
Sep 20 01:00:59.778168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.778147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.781008 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.780988    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e3070304-openshift-default-dockercfg-5jsz5\""
Sep 20 01:00:59.782469 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istiod-ca-cert\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782587 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-credential-socket\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782587 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-data\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782587 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-podinfo\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782755 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782600    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-socket\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782755 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-certs\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782755 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psd4d\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-kube-api-access-psd4d\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782755 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-envoy\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.782755 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-token\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.783162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.782921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-data\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.783162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.783147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-certs\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.783614 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.783589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-socket\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.783854 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.783837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-credential-socket\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.783972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.783903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istiod-ca-cert\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.785729 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.785701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-envoy\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.786327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.786308    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-podinfo\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.791076 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.791054    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"]
Sep 20 01:00:59.793608 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.793563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psd4d\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-kube-api-access-psd4d\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.793742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.793722    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-token\") pod \"e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") " pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.817627 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.817604    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:59.876730 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.876475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p" event={"ID":"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a","Type":"ContainerStarted","Data":"8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330"}
Sep 20 01:00:59.876834 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.876762    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:00:59.878865 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.878823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj" event={"ID":"188c387e-0a14-4d36-b958-aec8516bcc46","Type":"ContainerStarted","Data":"9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02"}
Sep 20 01:00:59.878987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.878941    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:00:59.884338 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-data\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-token\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-podinfo\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884526 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfd8q\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-kube-api-access-nfd8q\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884526 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istiod-ca-cert\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-credential-socket\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884678 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-certs\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884726 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-socket\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.884772 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.884753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-envoy\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.893085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.893025    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:00:59.900300 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.900259    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p" podStartSLOduration=2.359008329 podStartE2EDuration="3.900241201s" totalImagesPullingTime="1.541232872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:59.89901926 +0000 UTC m=+806.892294790" watchObservedRunningTime="2026-09-20 01:00:59.900241201 +0000 UTC m=+806.893516794"
Sep 20 01:00:59.922572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.922525    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj" podStartSLOduration=1.429892138 podStartE2EDuration="1.922508472s" totalImagesPullingTime="492.616334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:59.92045135 +0000 UTC m=+806.913726895" watchObservedRunningTime="2026-09-20 01:00:59.922508472 +0000 UTC m=+806.915784005"
Sep 20 01:00:59.931764 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.931725    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:00:59.985884 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.985855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-envoy\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986003 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.985917    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-data\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986097    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-token\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986211 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-podinfo\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986211 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfd8q\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-kube-api-access-nfd8q\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986308    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-data\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istiod-ca-cert\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986443 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986412    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-credential-socket\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986534 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-certs\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.986603 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-socket\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.987164 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.986836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-socket\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.987164 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.987102    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istiod-ca-cert\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.987164 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.987154    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-credential-socket\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.987374 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.987274    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-certs\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.989215 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.989167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-podinfo\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.989358 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.989339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-envoy\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.994407 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.994365    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfd8q\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-kube-api-access-nfd8q\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:00:59.994784 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:00:59.994748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-token\") pod \"e2e-ait-e3070304-openshift-default-b9558789b-6snf7\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") " pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:00.114623 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.114597    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:00.116465 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.116442    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:00.178219 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.175601    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"]
Sep 20 01:01:00.182138 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.182108    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:00.184071 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:01:00.184044    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b041eab_eaa8_4ed4_9b32_04e7cf68b63f.slice/crio-4431b41f351ffde93d3bdd49be5b68ca575e17c8b595b77330db8cd04f554f18 WatchSource:0}: Error finding container 4431b41f351ffde93d3bdd49be5b68ca575e17c8b595b77330db8cd04f554f18: Status 404 returned error can't find the container with id 4431b41f351ffde93d3bdd49be5b68ca575e17c8b595b77330db8cd04f554f18
Sep 20 01:01:00.186819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.186784    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:00.186918 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.186865    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:00.186976 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.186945    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:00.390793 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.390766    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"]
Sep 20 01:01:00.393510 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:01:00.393474    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8235d8bf_b46c_4291_ac90_7a1aa142ae8c.slice/crio-fbcaa89768949403180be09e3066ecd4969291da63d1d99f7ef6f3bfa2f8a4c3 WatchSource:0}: Error finding container fbcaa89768949403180be09e3066ecd4969291da63d1d99f7ef6f3bfa2f8a4c3: Status 404 returned error can't find the container with id fbcaa89768949403180be09e3066ecd4969291da63d1d99f7ef6f3bfa2f8a4c3
Sep 20 01:01:00.396227 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.396179    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:00.396322 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.396263    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:00.396322 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.396296    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:00.885532 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.885498    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" event={"ID":"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f","Type":"ContainerStarted","Data":"cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb"}
Sep 20 01:01:00.885708 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.885560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" event={"ID":"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f","Type":"ContainerStarted","Data":"4431b41f351ffde93d3bdd49be5b68ca575e17c8b595b77330db8cd04f554f18"}
Sep 20 01:01:00.887405 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.887375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" event={"ID":"8235d8bf-b46c-4291-ac90-7a1aa142ae8c","Type":"ContainerStarted","Data":"4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9"}
Sep 20 01:01:00.887545 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.887427    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" event={"ID":"8235d8bf-b46c-4291-ac90-7a1aa142ae8c","Type":"ContainerStarted","Data":"fbcaa89768949403180be09e3066ecd4969291da63d1d99f7ef6f3bfa2f8a4c3"}
Sep 20 01:01:00.893526 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.893504    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:00.908828 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.908779    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" podStartSLOduration=1.908766524 podStartE2EDuration="1.908766524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:00.907427276 +0000 UTC m=+807.900702843" watchObservedRunningTime="2026-09-20 01:01:00.908766524 +0000 UTC m=+807.902042056"
Sep 20 01:01:00.930473 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:00.930431    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podStartSLOduration=1.9304182669999999 podStartE2EDuration="1.930418267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:00.928666394 +0000 UTC m=+807.921941928" watchObservedRunningTime="2026-09-20 01:01:00.930418267 +0000 UTC m=+807.923693800"
Sep 20 01:01:01.117373 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:01.117341    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:01.122263 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:01.122239    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:01.615947 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:01.615884    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:01.892595 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:01.892521    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:01.893261 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:01.893239    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:01.897909 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:01.897887    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:02.333256 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:02.333227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:02.424222 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:02.424170    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:02.853696 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:02.853658    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:02.897787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:02.897753    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:02.898851 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:02.898825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:02.986905 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:02.986866    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:03.085182 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:03.085145    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:03.191434 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:03.191352    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:04.084385 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:04.084352    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:05.252503 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:05.252468    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:06.254216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:06.253609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:06.356944 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:06.356913    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:06.455295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:06.455265    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:06.785996 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:06.785960    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:06.887895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:06.887861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:07.272219 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:07.272080    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:07.368771 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:07.368739    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:07.616373 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:07.616289    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:07.770611 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:07.770581    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:07.867582 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:07.867498    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:08.314261 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:08.314218    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:08.481445 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:08.481407    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:08.970040 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:08.970007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.069834 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.069785    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.171363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.171330    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.308499 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.308463    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.383490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.383453    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.457775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.457743    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.510592 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.510564    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"]
Sep 20 01:01:09.513415 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.513394    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.516301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.516275    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-376bcf-openshift-default-dockercfg-jb2pb\""
Sep 20 01:01:09.530608 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.530581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"]
Sep 20 01:01:09.602511 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-envoy\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602511 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602469    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-data\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92m2\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-kube-api-access-k92m2\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602565    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-socket\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-credential-socket\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602622    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-certs\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-podinfo\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-token\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.602766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.602735    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cbabe-b109-4b5d-8fee-77663eda021f-istiod-ca-cert\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.604308 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.604276    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.703540 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-envoy\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703540 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-data\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92m2\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-kube-api-access-k92m2\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-socket\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-credential-socket\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-certs\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-podinfo\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-token\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.703823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.703761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cbabe-b109-4b5d-8fee-77663eda021f-istiod-ca-cert\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.704238 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.704014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-credential-socket\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.704238 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.704165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-socket\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.704238 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.704180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-certs\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.704411 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.704290    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-data\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.704692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.704672    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cbabe-b109-4b5d-8fee-77663eda021f-istiod-ca-cert\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.706037 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.706016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-envoy\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.706577 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.706555    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-podinfo\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.712985 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.712961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-token\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.713569 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.713550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92m2\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-kube-api-access-k92m2\") pod \"e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") " pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:09.797098 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.797071    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:09.824370 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:09.824346    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:10.110893 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.110864    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"]
Sep 20 01:01:10.114669 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:01:10.114630    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1cbabe_b109_4b5d_8fee_77663eda021f.slice/crio-006bc279927e2794a49dd33fcaa18af2c9831e9e1f11b6af118b05073fe02bce WatchSource:0}: Error finding container 006bc279927e2794a49dd33fcaa18af2c9831e9e1f11b6af118b05073fe02bce: Status 404 returned error can't find the container with id 006bc279927e2794a49dd33fcaa18af2c9831e9e1f11b6af118b05073fe02bce
Sep 20 01:01:10.117286 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.117245    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:10.117393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.117328    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:10.117393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.117372    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:10.426601 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.426461    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:10.889838 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.889805    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:01:10.890023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.889980    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:01:10.940103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.940069    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" event={"ID":"3c1cbabe-b109-4b5d-8fee-77663eda021f","Type":"ContainerStarted","Data":"0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee"}
Sep 20 01:01:10.940307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.940128    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" event={"ID":"3c1cbabe-b109-4b5d-8fee-77663eda021f","Type":"ContainerStarted","Data":"006bc279927e2794a49dd33fcaa18af2c9831e9e1f11b6af118b05073fe02bce"}
Sep 20 01:01:10.967243 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:10.967171    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podStartSLOduration=1.9671562649999998 podStartE2EDuration="1.967156265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:10.965508339 +0000 UTC m=+817.958783873" watchObservedRunningTime="2026-09-20 01:01:10.967156265 +0000 UTC m=+817.960431798"
Sep 20 01:01:11.187443 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.187365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:11.405298 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.405259    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:11.561901 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.561852    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:11.660321 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.660289    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:11.722540 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.722508    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:11.824656 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.824571    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:11.829279 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.829249    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:11.944735 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.944708    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:11.945542 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:11.945525    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:12.155457 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.155367    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:12.950826 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.950763    2571 generic.go:356] "Generic (PLEG): container finished" podID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerID="b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c" exitCode=0
Sep 20 01:01:12.951247 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.950837    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" event={"ID":"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e","Type":"ContainerDied","Data":"b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c"}
Sep 20 01:01:12.951301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.951286    2571 scope.go:117] "RemoveContainer" containerID="b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c"
Sep 20 01:01:12.955048 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.955016    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:12.955143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.955104    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:12.955143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.955134    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:12.981648 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:12.981627    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:13.110578 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:13.110493    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:13.210795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:13.210760    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:01:13.958741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:13.958702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" event={"ID":"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e","Type":"ContainerStarted","Data":"6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32"}
Sep 20 01:01:14.057270 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:14.057231    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:14.404960 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:14.404916    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:01:14.405281 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:14.405255    2571 patch_prober.go:28] interesting pod/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 20 01:01:14.405384 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:14.405311    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 20 01:01:14.413282 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:14.413255    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:14.883052 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:14.883010    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:15.405216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:15.404683    2571 patch_prober.go:28] interesting pod/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 20 01:01:15.405216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:15.404761    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 20 01:01:15.726331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:15.726234    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:16.189084 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:16.189030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:16.404925 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:16.404877    2571 patch_prober.go:28] interesting pod/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 20 01:01:16.405139 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:16.404950    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 20 01:01:16.496067 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:16.495971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:17.234624 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:17.234577    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:17.405217 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:17.405150    2571 patch_prober.go:28] interesting pod/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 20 01:01:17.405405 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:17.405229    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 20 01:01:18.116944 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.116897    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:18.214410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.214376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:18.404695 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.404607    2571 patch_prober.go:28] interesting pod/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 20 01:01:18.404942 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.404914    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 20 01:01:18.591991 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.591945    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:18.709275 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.706735    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:18.791301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.791259    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:18.817691 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.817633    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"]
Sep 20 01:01:18.821736 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.821711    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:18.826593 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.826563    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-376bcf\""
Sep 20 01:01:18.834262 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.834240    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"]
Sep 20 01:01:18.852226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.850319    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"]
Sep 20 01:01:18.870249 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.870223    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:18.890213 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.889379    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-376bcf-dockercfg-5bvnc\""
Sep 20 01:01:18.890213 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.890146    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:18.890447 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.890218    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"]
Sep 20 01:01:18.923215 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.920708    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/407bb8cb-3056-420b-a254-3053766f3597-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:18.923215 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.920758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66xkm\" (UniqueName: \"kubernetes.io/projected/407bb8cb-3056-420b-a254-3053766f3597-kube-api-access-66xkm\") pod \"payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:18.923215 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.920937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgm9w\" (UniqueName: \"kubernetes.io/projected/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-kube-api-access-kgm9w\") pod \"payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:18.923215 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:18.920972    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:19.021860 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.021806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgm9w\" (UniqueName: \"kubernetes.io/projected/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-kube-api-access-kgm9w\") pod \"payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:19.022156 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.022127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:19.022322 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.022304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/407bb8cb-3056-420b-a254-3053766f3597-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:19.022470 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.022453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66xkm\" (UniqueName: \"kubernetes.io/projected/407bb8cb-3056-420b-a254-3053766f3597-kube-api-access-66xkm\") pod \"payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:19.024548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.024528    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:19.025645 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.025623    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/407bb8cb-3056-420b-a254-3053766f3597-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:19.037959 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.037940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgm9w\" (UniqueName: \"kubernetes.io/projected/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-kube-api-access-kgm9w\") pod \"payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:19.050250 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.050231    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66xkm\" (UniqueName: \"kubernetes.io/projected/407bb8cb-3056-420b-a254-3053766f3597-kube-api-access-66xkm\") pod \"payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:19.144434 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.144394    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:19.224622 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.224580    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:19.311295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.310785    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:19.405797 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.405298    2571 patch_prober.go:28] interesting pod/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 20 01:01:19.405797 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.405364    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 20 01:01:19.626266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.621347    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"]
Sep 20 01:01:19.640260 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:01:19.636998    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407bb8cb_3056_420b_a254_3053766f3597.slice/crio-9648e8bb534b180348f899c8f2bc0dd382dd891bfb1e7da06f8cd837a1fde1c3 WatchSource:0}: Error finding container 9648e8bb534b180348f899c8f2bc0dd382dd891bfb1e7da06f8cd837a1fde1c3: Status 404 returned error can't find the container with id 9648e8bb534b180348f899c8f2bc0dd382dd891bfb1e7da06f8cd837a1fde1c3
Sep 20 01:01:19.699437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.690285    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"]
Sep 20 01:01:19.992142 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:19.991968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:20.009242 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.008362    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn" event={"ID":"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f","Type":"ContainerStarted","Data":"70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b"}
Sep 20 01:01:20.009242 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.008430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn" event={"ID":"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f","Type":"ContainerStarted","Data":"3a3b5acac2a97edf087fd4dbcf1d3ba070bfabe2442be23ee901e363de9f1e8c"}
Sep 20 01:01:20.009644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.009590    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:20.015054 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.014968    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr" event={"ID":"407bb8cb-3056-420b-a254-3053766f3597","Type":"ContainerStarted","Data":"597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976"}
Sep 20 01:01:20.015054 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.015016    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr" event={"ID":"407bb8cb-3056-420b-a254-3053766f3597","Type":"ContainerStarted","Data":"9648e8bb534b180348f899c8f2bc0dd382dd891bfb1e7da06f8cd837a1fde1c3"}
Sep 20 01:01:20.029383 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.029330    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn" podStartSLOduration=2.029313841 podStartE2EDuration="2.029313841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:20.027090758 +0000 UTC m=+827.020366293" watchObservedRunningTime="2026-09-20 01:01:20.029313841 +0000 UTC m=+827.022589374"
Sep 20 01:01:20.045544 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.045484    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr" podStartSLOduration=2.045464517 podStartE2EDuration="2.045464517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:20.04329957 +0000 UTC m=+827.036575104" watchObservedRunningTime="2026-09-20 01:01:20.045464517 +0000 UTC m=+827.038740051"
Sep 20 01:01:20.097720 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.097688    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:20.408782 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.408756    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:01:20.409234 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.409010    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:01:20.409800 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.409782    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:01:20.937860 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:20.937816    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:21.021892 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:21.021860    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:21.637895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:21.637857    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:22.351015 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:22.350977    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:22.645943 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:22.645857    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:23.102852 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:23.102810    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:24.039224 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.039181    2571 generic.go:356] "Generic (PLEG): container finished" podID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerID="4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9" exitCode=0
Sep 20 01:01:24.039741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.039262    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" event={"ID":"8235d8bf-b46c-4291-ac90-7a1aa142ae8c","Type":"ContainerDied","Data":"4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9"}
Sep 20 01:01:24.039806 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.039768    2571 scope.go:117] "RemoveContainer" containerID="4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9"
Sep 20 01:01:24.041166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.041141    2571 generic.go:356] "Generic (PLEG): container finished" podID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerID="cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb" exitCode=0
Sep 20 01:01:24.041166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.041155    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:24.041348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.041177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" event={"ID":"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f","Type":"ContainerDied","Data":"cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb"}
Sep 20 01:01:24.041348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.041260    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:24.041348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.041308    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:24.041528 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.041514    2571 scope.go:117] "RemoveContainer" containerID="cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb"
Sep 20 01:01:24.042669 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.042640    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:24.042756 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.042722    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:24.042799 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.042755    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:24.114161 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.114120    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:24.830916 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:24.830880    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:25.051900 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.051865    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" event={"ID":"8235d8bf-b46c-4291-ac90-7a1aa142ae8c","Type":"ContainerStarted","Data":"e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4"}
Sep 20 01:01:25.056322 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.056291    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" event={"ID":"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f","Type":"ContainerStarted","Data":"275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda"}
Sep 20 01:01:25.117490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.117393    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:25.118258 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.118103    2571 patch_prober.go:28] interesting pod/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 20 01:01:25.118575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.118534    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 20 01:01:25.119483 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.119411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:25.203569 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.203535    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:25.300130 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.299966    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:25.502365 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.502325    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:25.873076 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.872976    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:25.893965 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.893889    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:25.894854 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.894528    2571 patch_prober.go:28] interesting pod/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 20 01:01:25.894854 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:25.894584    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 20 01:01:26.117469 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:26.117429    2571 patch_prober.go:28] interesting pod/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 20 01:01:26.117922 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:26.117489    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 20 01:01:26.585209 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:26.585155    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:26.893935 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:26.893841    2571 patch_prober.go:28] interesting pod/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 20 01:01:26.894323 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:26.894291    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 20 01:01:27.117826 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.117392    2571 patch_prober.go:28] interesting pod/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 20 01:01:27.117826 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.117453    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 20 01:01:27.426048 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.425959    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:27.716421 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.716335    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"]
Sep 20 01:01:27.719201 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.719167    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"
Sep 20 01:01:27.722258 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.722236    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:01:27.727397 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.727374    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:01:27.735805 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.735784    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"]
Sep 20 01:01:27.825239 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.824760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3070304-xwvkq\" (UID: \"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"
Sep 20 01:01:27.893618 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.893578    2571 patch_prober.go:28] interesting pod/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 20 01:01:27.893894 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.893865    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 20 01:01:27.925807 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.925768    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3070304-xwvkq\" (UID: \"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"
Sep 20 01:01:27.926451 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:27.926431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3070304-xwvkq\" (UID: \"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"
Sep 20 01:01:28.029313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:28.029275    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"
Sep 20 01:01:28.120225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:28.119606    2571 patch_prober.go:28] interesting pod/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 20 01:01:28.120225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:28.119673    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 20 01:01:28.363270 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:28.363153    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:28.418399 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:28.407666    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"]
Sep 20 01:01:28.893547 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:28.893511    2571 patch_prober.go:28] interesting pod/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 20 01:01:28.893818 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:28.893789    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 20 01:01:29.095226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:29.095166    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq" event={"ID":"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f","Type":"ContainerStarted","Data":"7b82e4920044df5bf882db65a6f704ec0d0cf18f4baa9521d8127ced2cb4f848"}
Sep 20 01:01:29.117864 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:29.117821    2571 patch_prober.go:28] interesting pod/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 20 01:01:29.118064 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:29.117883    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 20 01:01:29.220251 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:29.220159    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:29.897049 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:29.896600    2571 patch_prober.go:28] interesting pod/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 20 01:01:29.897049 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:29.896664    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 20 01:01:30.117396 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:30.116972    2571 patch_prober.go:28] interesting pod/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 20 01:01:30.117396 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:30.117029    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 20 01:01:30.134374 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:30.134337    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:30.844420 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:30.844369    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:30.897524 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:30.897497    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:30.897904 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:30.897882    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:30.898529 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:30.898509    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:01:31.122598 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:31.122495    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:31.122921 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:31.122903    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:31.123872 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:31.123842    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:31.492624 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:31.492532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:31.593749 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:31.593718    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:31.693168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:31.693130    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:32.028921 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:32.028838    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:01:32.029332 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:32.029115    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:01:32.121731 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:32.121695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq" event={"ID":"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f","Type":"ContainerStarted","Data":"2324bd1fb652d0e0e4ebd4ecac7f69c34050f2c7265d18b547d27c0e33efcdc1"}
Sep 20 01:01:32.138376 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:32.138327    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq" podStartSLOduration=2.060174472 podStartE2EDuration="5.138312002s" totalImagesPullingTime="3.07813753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:32.136565706 +0000 UTC m=+839.129841241" watchObservedRunningTime="2026-09-20 01:01:32.138312002 +0000 UTC m=+839.131587535"
Sep 20 01:01:32.607637 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:32.607549    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:32.708454 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:32.708419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:32.717284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:32.717246    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:01:33.128741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:33.128700    2571 generic.go:356] "Generic (PLEG): container finished" podID="f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f" containerID="2324bd1fb652d0e0e4ebd4ecac7f69c34050f2c7265d18b547d27c0e33efcdc1" exitCode=0
Sep 20 01:01:33.129166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:33.128767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq" event={"ID":"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f","Type":"ContainerDied","Data":"2324bd1fb652d0e0e4ebd4ecac7f69c34050f2c7265d18b547d27c0e33efcdc1"}
Sep 20 01:01:33.387000 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:33.386909    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:34.135252 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.135185    2571 generic.go:356] "Generic (PLEG): container finished" podID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerID="0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee" exitCode=0
Sep 20 01:01:34.135676 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.135265    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" event={"ID":"3c1cbabe-b109-4b5d-8fee-77663eda021f","Type":"ContainerDied","Data":"0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee"}
Sep 20 01:01:34.136038 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.135740    2571 scope.go:117] "RemoveContainer" containerID="0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee"
Sep 20 01:01:34.137036 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.136999    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:34.137127 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.137092    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:34.137166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.137138    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:01:34.149157 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.149127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:34.298250 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.298222    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"
Sep 20 01:01:34.401019 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.400948    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f-maas-api-service-ca\") pod \"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f\" (UID: \"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f\") "
Sep 20 01:01:34.401394 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.401365    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f" (UID: "f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:01:34.501600 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.501575    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:34.974381 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:34.974326    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:35.145030 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.144985    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" event={"ID":"3c1cbabe-b109-4b5d-8fee-77663eda021f","Type":"ContainerStarted","Data":"77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec"}
Sep 20 01:01:35.147448 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.147418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq" event={"ID":"f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f","Type":"ContainerDied","Data":"7b82e4920044df5bf882db65a6f704ec0d0cf18f4baa9521d8127ced2cb4f848"}
Sep 20 01:01:35.147567 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.147469    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b82e4920044df5bf882db65a6f704ec0d0cf18f4baa9521d8127ced2cb4f848"
Sep 20 01:01:35.147567 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.147542    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"
Sep 20 01:01:35.699680 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.699647    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:35.825040 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.825008    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:35.825291 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.825266    2571 patch_prober.go:28] interesting pod/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 20 01:01:35.825393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:35.825340    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 20 01:01:36.424869 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:36.424837    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:36.825409 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:36.825370    2571 patch_prober.go:28] interesting pod/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 20 01:01:36.825567 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:36.825436    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 20 01:01:37.825117 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:37.825079    2571 patch_prober.go:28] interesting pod/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 20 01:01:37.825498 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:37.825142    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 20 01:01:38.825275 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:38.825241    2571 patch_prober.go:28] interesting pod/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 20 01:01:38.825806 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:38.825778    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 20 01:01:39.161033 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:39.160935    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:39.825158 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:39.825123    2571 patch_prober.go:28] interesting pod/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Sep 20 01:01:39.825362 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:39.825234    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Sep 20 01:01:40.830051 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:40.830012    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:40.830527 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:40.830409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:40.831284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:40.831262    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:01:43.665229 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:43.665173    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:44.265836 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.265775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:44.366896 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.366863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:44.466899 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.466867    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:44.512906 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.512877    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"]
Sep 20 01:01:44.515295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.515270    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3070304-xwvkq"]
Sep 20 01:01:44.537315 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.537227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:44.646769 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.646733    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"]
Sep 20 01:01:44.647012 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.646985    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" containerID="cri-o://e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4" gracePeriod=30
Sep 20 01:01:44.671327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:44.671303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:45.013388 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:45.013345    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:45.134815 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:45.134786    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:45.232584 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:45.232541    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:45.337830 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:45.337759    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:45.508897 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:45.508856    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f" path="/var/lib/kubelet/pods/f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f/volumes"
Sep 20 01:01:45.764928 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:45.764897    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:45.862544 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:45.862514    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:46.021262 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:46.021157    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:46.125257 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:46.125213    2571 patch_prober.go:28] interesting pod/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 01:01:46.125412 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:46.125310    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 01:01:46.949148 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:46.949110    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:47.555241 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:47.555202    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:48.115925 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:48.115893    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:48.216826 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:48.216790    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:48.409625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:48.409546    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:49.434339 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:49.434306    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:49.886751 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:49.886722    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:50.039109 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039048    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istiod-ca-cert\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039109 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039086    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-credential-socket\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039329 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039117    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-envoy\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039329 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039174    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-data\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039329 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039232    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfd8q\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-kube-api-access-nfd8q\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039329 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039254    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-certs\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039329 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039287    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-podinfo\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039573 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039349    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-socket\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039573 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039422    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-token\") pod \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\" (UID: \"8235d8bf-b46c-4291-ac90-7a1aa142ae8c\") "
Sep 20 01:01:50.039573 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039538    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:01:50.039573 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039555    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:01:50.039770 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039577    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:01:50.039770 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039723    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:01:50.039879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039800    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:01:50.039917 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039892    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.039953 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039914    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.039953 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039928    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.039953 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039941    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.040066 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.039955    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.041518 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.041490    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:01:50.041634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.041523    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:01:50.041905 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.041885    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-kube-api-access-nfd8q" (OuterVolumeSpecName: "kube-api-access-nfd8q") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "kube-api-access-nfd8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:01:50.041972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.041915    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8235d8bf-b46c-4291-ac90-7a1aa142ae8c" (UID: "8235d8bf-b46c-4291-ac90-7a1aa142ae8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:01:50.141173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.140959    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.141173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.140988    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.141173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.141001    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfd8q\" (UniqueName: \"kubernetes.io/projected/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-kube-api-access-nfd8q\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.141173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.141014    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8235d8bf-b46c-4291-ac90-7a1aa142ae8c-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:01:50.170050 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.170023    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:50.237202 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.237162    2571 generic.go:356] "Generic (PLEG): container finished" podID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerID="e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4" exitCode=0
Sep 20 01:01:50.237308 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.237213    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"
Sep 20 01:01:50.237308 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.237242    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" event={"ID":"8235d8bf-b46c-4291-ac90-7a1aa142ae8c","Type":"ContainerDied","Data":"e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4"}
Sep 20 01:01:50.237308 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.237291    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7" event={"ID":"8235d8bf-b46c-4291-ac90-7a1aa142ae8c","Type":"ContainerDied","Data":"fbcaa89768949403180be09e3066ecd4969291da63d1d99f7ef6f3bfa2f8a4c3"}
Sep 20 01:01:50.237435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.237319    2571 scope.go:117] "RemoveContainer" containerID="e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4"
Sep 20 01:01:50.248724 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.248664    2571 scope.go:117] "RemoveContainer" containerID="4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9"
Sep 20 01:01:50.261434 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.261415    2571 scope.go:117] "RemoveContainer" containerID="e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4"
Sep 20 01:01:50.261697 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:01:50.261675    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4\": container with ID starting with e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4 not found: ID does not exist" containerID="e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4"
Sep 20 01:01:50.261752 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.261705    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4"} err="failed to get container status \"e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4\": rpc error: code = NotFound desc = could not find container \"e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4\": container with ID starting with e079f8dc5b15d119256a3466e3f4c3b9014feac35a0eb1f4fd2be3d24d6d4df4 not found: ID does not exist"
Sep 20 01:01:50.261752 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.261724    2571 scope.go:117] "RemoveContainer" containerID="4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9"
Sep 20 01:01:50.261983 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:01:50.261966    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9\": container with ID starting with 4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9 not found: ID does not exist" containerID="4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9"
Sep 20 01:01:50.262038 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.261992    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9"} err="failed to get container status \"4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9\": rpc error: code = NotFound desc = could not find container \"4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9\": container with ID starting with 4ac9220a63d76cb84b5eda0236940e562e57eb14ec2cfef6b1111e9951cb66b9 not found: ID does not exist"
Sep 20 01:01:50.265468 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.265448    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"]
Sep 20 01:01:50.271718 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.271684    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:50.274945 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.274915    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7"]
Sep 20 01:01:50.511157 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.511134    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:50.701847 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.701818    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:01:50.719914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.719890    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:50.814601 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.814535    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:50.819598 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.819575    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"]
Sep 20 01:01:50.819941 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.819930    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy"
Sep 20 01:01:50.819984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.819942    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy"
Sep 20 01:01:50.819984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.819951    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy"
Sep 20 01:01:50.819984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.819956    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy"
Sep 20 01:01:50.819984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.819964    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f" containerName="revoke-keys"
Sep 20 01:01:50.819984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.819970    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f" containerName="revoke-keys"
Sep 20 01:01:50.820137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.820029    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy"
Sep 20 01:01:50.820137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.820040    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5a63eaf-1128-41a7-b8f4-552a9a6b3d9f" containerName="revoke-keys"
Sep 20 01:01:50.820137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.820046    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" containerName="istio-proxy"
Sep 20 01:01:50.822764 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.822745    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:50.825363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.825343    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-816f617b\""
Sep 20 01:01:50.833814 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.833793    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"]
Sep 20 01:01:50.848790 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.848770    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"]
Sep 20 01:01:50.850961 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.850942    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:50.853430 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.853405    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-816f617b-dockercfg-md2fq\""
Sep 20 01:01:50.865324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.865301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"]
Sep 20 01:01:50.947942 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.947903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccw5h\" (UniqueName: \"kubernetes.io/projected/3ff49d5e-71aa-417f-b5ef-4314c401daa4-kube-api-access-ccw5h\") pod \"payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:50.948169 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.947985    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5bgc\" (UniqueName: \"kubernetes.io/projected/ce345362-f3e5-4560-a60a-384693c0e9f3-kube-api-access-r5bgc\") pod \"payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:50.948169 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.948036    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce345362-f3e5-4560-a60a-384693c0e9f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:50.948169 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:50.948063    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ff49d5e-71aa-417f-b5ef-4314c401daa4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:51.049206 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.049165    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccw5h\" (UniqueName: \"kubernetes.io/projected/3ff49d5e-71aa-417f-b5ef-4314c401daa4-kube-api-access-ccw5h\") pod \"payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:51.049375 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.049261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5bgc\" (UniqueName: \"kubernetes.io/projected/ce345362-f3e5-4560-a60a-384693c0e9f3-kube-api-access-r5bgc\") pod \"payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:51.049375 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.049300    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce345362-f3e5-4560-a60a-384693c0e9f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:51.049375 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.049325    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ff49d5e-71aa-417f-b5ef-4314c401daa4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:51.050023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.049996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ff49d5e-71aa-417f-b5ef-4314c401daa4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:51.050023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.050008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce345362-f3e5-4560-a60a-384693c0e9f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:51.057933 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.057906    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5bgc\" (UniqueName: \"kubernetes.io/projected/ce345362-f3e5-4560-a60a-384693c0e9f3-kube-api-access-r5bgc\") pod \"payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:51.058276 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.058256    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccw5h\" (UniqueName: \"kubernetes.io/projected/3ff49d5e-71aa-417f-b5ef-4314c401daa4-kube-api-access-ccw5h\") pod \"payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:51.133125 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.133071    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:51.161018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.160989    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:51.231517 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.231468    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:51.404101 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.404075    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"]
Sep 20 01:01:51.405813 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:01:51.405781    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce345362_f3e5_4560_a60a_384693c0e9f3.slice/crio-0443e8dea2069ed4ca1b75017569b549e49a7e3a2b1ce1519027bff1a5a2fd2e WatchSource:0}: Error finding container 0443e8dea2069ed4ca1b75017569b549e49a7e3a2b1ce1519027bff1a5a2fd2e: Status 404 returned error can't find the container with id 0443e8dea2069ed4ca1b75017569b549e49a7e3a2b1ce1519027bff1a5a2fd2e
Sep 20 01:01:51.444126 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.444098    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"]
Sep 20 01:01:51.444809 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:01:51.444782    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff49d5e_71aa_417f_b5ef_4314c401daa4.slice/crio-aaa0e382340bdaaeb16a1bbd65f239ed433028ebb19e83d68adf1905a4ad308e WatchSource:0}: Error finding container aaa0e382340bdaaeb16a1bbd65f239ed433028ebb19e83d68adf1905a4ad308e: Status 404 returned error can't find the container with id aaa0e382340bdaaeb16a1bbd65f239ed433028ebb19e83d68adf1905a4ad308e
Sep 20 01:01:51.509823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.509798    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8235d8bf-b46c-4291-ac90-7a1aa142ae8c" path="/var/lib/kubelet/pods/8235d8bf-b46c-4291-ac90-7a1aa142ae8c/volumes"
Sep 20 01:01:51.953028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:51.952996    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:52.251295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.251260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc" event={"ID":"3ff49d5e-71aa-417f-b5ef-4314c401daa4","Type":"ContainerStarted","Data":"5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1"}
Sep 20 01:01:52.251480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.251321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc" event={"ID":"3ff49d5e-71aa-417f-b5ef-4314c401daa4","Type":"ContainerStarted","Data":"aaa0e382340bdaaeb16a1bbd65f239ed433028ebb19e83d68adf1905a4ad308e"}
Sep 20 01:01:52.251480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.251353    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:01:52.252896 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.252871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk" event={"ID":"ce345362-f3e5-4560-a60a-384693c0e9f3","Type":"ContainerStarted","Data":"e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1"}
Sep 20 01:01:52.253018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.252911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk" event={"ID":"ce345362-f3e5-4560-a60a-384693c0e9f3","Type":"ContainerStarted","Data":"0443e8dea2069ed4ca1b75017569b549e49a7e3a2b1ce1519027bff1a5a2fd2e"}
Sep 20 01:01:52.253018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.252960    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:01:52.267925 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.267885    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc" podStartSLOduration=2.267871473 podStartE2EDuration="2.267871473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:52.267032128 +0000 UTC m=+859.260307662" watchObservedRunningTime="2026-09-20 01:01:52.267871473 +0000 UTC m=+859.261147004"
Sep 20 01:01:52.284225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.284154    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk" podStartSLOduration=2.284136549 podStartE2EDuration="2.284136549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:52.282989327 +0000 UTC m=+859.276264861" watchObservedRunningTime="2026-09-20 01:01:52.284136549 +0000 UTC m=+859.277412082"
Sep 20 01:01:52.664885 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:52.664805    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:53.545168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.545135    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:53.588200 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.588162    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"]
Sep 20 01:01:53.591628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.591610    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.594287 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.594268    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"openshift-service-ca.crt\""
Sep 20 01:01:53.595479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.595457    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"simulator-w0-e2e8bc-kserve-self-signed-certs\""
Sep 20 01:01:53.595763 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.595745    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"kube-root-ca.crt\""
Sep 20 01:01:53.595884 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.595803    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"default-dockercfg-f5qb4\""
Sep 20 01:01:53.600915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.600893    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"]
Sep 20 01:01:53.774997 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.774963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-home\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.775166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.775013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-model-cache\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.775166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.775077    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-dshm\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.775166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.775128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cp8t\" (UniqueName: \"kubernetes.io/projected/bc89966b-fc69-4617-993d-3e5f383619bb-kube-api-access-8cp8t\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.775166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.775156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc89966b-fc69-4617-993d-3e5f383619bb-tls-certs\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.775369 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.775221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-tmp-dir\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cp8t\" (UniqueName: \"kubernetes.io/projected/bc89966b-fc69-4617-993d-3e5f383619bb-kube-api-access-8cp8t\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc89966b-fc69-4617-993d-3e5f383619bb-tls-certs\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-tmp-dir\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876571 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-home\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876571 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-model-cache\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876571 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-dshm\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876768 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876741    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-tmp-dir\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.876931 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.876911    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-home\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.877079 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.877049    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-model-cache\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.878909 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.878882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-dshm\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.879473 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.879450    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc89966b-fc69-4617-993d-3e5f383619bb-tls-certs\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.885506 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.885485    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cp8t\" (UniqueName: \"kubernetes.io/projected/bc89966b-fc69-4617-993d-3e5f383619bb-kube-api-access-8cp8t\") pod \"simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") " pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:53.889316 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.889291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:53.901240 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:53.901221    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:01:54.173816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:54.173787    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"]
Sep 20 01:01:54.176035 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:01:54.176006    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc89966b_fc69_4617_993d_3e5f383619bb.slice/crio-653faee22404608c5f10f0648273ce0b068fe19ac8515de16fae0d0c190bab22 WatchSource:0}: Error finding container 653faee22404608c5f10f0648273ce0b068fe19ac8515de16fae0d0c190bab22: Status 404 returned error can't find the container with id 653faee22404608c5f10f0648273ce0b068fe19ac8515de16fae0d0c190bab22
Sep 20 01:01:54.265378 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:54.265352    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7" event={"ID":"bc89966b-fc69-4617-993d-3e5f383619bb","Type":"ContainerStarted","Data":"682f192c6969c285506cfc8645dbd6074a5974f96177326e9109eb3b702a589f"}
Sep 20 01:01:54.265485 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:54.265388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7" event={"ID":"bc89966b-fc69-4617-993d-3e5f383619bb","Type":"ContainerStarted","Data":"653faee22404608c5f10f0648273ce0b068fe19ac8515de16fae0d0c190bab22"}
Sep 20 01:01:54.283095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:54.283053    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7" podStartSLOduration=1.283039461 podStartE2EDuration="1.283039461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:54.281098326 +0000 UTC m=+861.274373859" watchObservedRunningTime="2026-09-20 01:01:54.283039461 +0000 UTC m=+861.276314993"
Sep 20 01:01:56.014372 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:56.014330    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:01:56.071741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:01:56.071709    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:03.260418 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:03.260386    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:02:03.260982 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:03.260473    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:02:03.901628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:03.901595    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:02:03.901808 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:03.901641    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:02:03.913717 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:03.913694    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:02:04.331037 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:04.331008    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:02:06.599410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:06.599371    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:02:12.268035 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:12.267995    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:13.081615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.081578    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"]
Sep 20 01:02:13.085289 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.085269    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"
Sep 20 01:02:13.088505 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.088476    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:02:13.088618 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.088483    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:02:13.095339 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.095303    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"]
Sep 20 01:02:13.130520 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.130490    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:13.142451 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.142426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdfb815-defc-4ed2-9d7f-6ae96458efab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf\" (UID: \"3cdfb815-defc-4ed2-9d7f-6ae96458efab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"
Sep 20 01:02:13.243555 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.243527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdfb815-defc-4ed2-9d7f-6ae96458efab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf\" (UID: \"3cdfb815-defc-4ed2-9d7f-6ae96458efab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"
Sep 20 01:02:13.244177 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.244159    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdfb815-defc-4ed2-9d7f-6ae96458efab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf\" (UID: \"3cdfb815-defc-4ed2-9d7f-6ae96458efab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"
Sep 20 01:02:13.397551 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.397487    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"
Sep 20 01:02:13.682151 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:13.682079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"]
Sep 20 01:02:13.685023 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:02:13.684991    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdfb815_defc_4ed2_9d7f_6ae96458efab.slice/crio-0b68919218ebd20776848d3fc090e750bf1b34b96deaf7a9826d443d66cd161b WatchSource:0}: Error finding container 0b68919218ebd20776848d3fc090e750bf1b34b96deaf7a9826d443d66cd161b: Status 404 returned error can't find the container with id 0b68919218ebd20776848d3fc090e750bf1b34b96deaf7a9826d443d66cd161b
Sep 20 01:02:14.040036 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:14.040010    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:14.370997 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:14.370968    2571 generic.go:356] "Generic (PLEG): container finished" podID="3cdfb815-defc-4ed2-9d7f-6ae96458efab" containerID="69aa69d276f3ab94d6331ea602a8b31df863787ea4ffefb32d9eb6dd9c95d3b6" exitCode=0
Sep 20 01:02:14.371112 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:14.371023    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf" event={"ID":"3cdfb815-defc-4ed2-9d7f-6ae96458efab","Type":"ContainerDied","Data":"69aa69d276f3ab94d6331ea602a8b31df863787ea4ffefb32d9eb6dd9c95d3b6"}
Sep 20 01:02:14.371112 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:14.371062    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf" event={"ID":"3cdfb815-defc-4ed2-9d7f-6ae96458efab","Type":"ContainerStarted","Data":"0b68919218ebd20776848d3fc090e750bf1b34b96deaf7a9826d443d66cd161b"}
Sep 20 01:02:14.874492 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:14.874461    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:15.524722 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:15.524693    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"
Sep 20 01:02:15.564955 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:15.564914    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdfb815-defc-4ed2-9d7f-6ae96458efab-maas-api-service-ca\") pod \"3cdfb815-defc-4ed2-9d7f-6ae96458efab\" (UID: \"3cdfb815-defc-4ed2-9d7f-6ae96458efab\") "
Sep 20 01:02:15.565358 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:15.565329    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdfb815-defc-4ed2-9d7f-6ae96458efab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3cdfb815-defc-4ed2-9d7f-6ae96458efab" (UID: "3cdfb815-defc-4ed2-9d7f-6ae96458efab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:15.617275 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:15.617238    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:15.666516 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:15.666438    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cdfb815-defc-4ed2-9d7f-6ae96458efab-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:02:16.382255 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:16.382229    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"
Sep 20 01:02:16.382644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:16.382263    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf" event={"ID":"3cdfb815-defc-4ed2-9d7f-6ae96458efab","Type":"ContainerDied","Data":"0b68919218ebd20776848d3fc090e750bf1b34b96deaf7a9826d443d66cd161b"}
Sep 20 01:02:16.382644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:16.382307    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b68919218ebd20776848d3fc090e750bf1b34b96deaf7a9826d443d66cd161b"
Sep 20 01:02:16.472178 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:16.472148    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:17.224201 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:17.224172    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:17.925580 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:17.925537    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:18.738305 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:18.738265    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:19.363756 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.363717    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:19.387878 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.387848    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"]
Sep 20 01:02:19.388067 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.388043    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc" podUID="3ff49d5e-71aa-417f-b5ef-4314c401daa4" containerName="payload-processing" containerID="cri-o://5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1" gracePeriod=30
Sep 20 01:02:19.397088 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.397043    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"]
Sep 20 01:02:19.397312 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.397287    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk" podUID="ce345362-f3e5-4560-a60a-384693c0e9f3" containerName="payload-pre-processing" containerID="cri-o://e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1" gracePeriod=30
Sep 20 01:02:19.434368 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.434321    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:19.493570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.493541    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:19.565219 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.565174    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"]
Sep 20 01:02:19.567920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.567894    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-816f617b-zgqdf"]
Sep 20 01:02:19.568741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.568714    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:19.639952 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.639876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:19.668094 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.668075    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:02:19.671666 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.671644    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:02:19.697332 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.697308    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5bgc\" (UniqueName: \"kubernetes.io/projected/ce345362-f3e5-4560-a60a-384693c0e9f3-kube-api-access-r5bgc\") pod \"ce345362-f3e5-4560-a60a-384693c0e9f3\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") "
Sep 20 01:02:19.697420 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.697346    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce345362-f3e5-4560-a60a-384693c0e9f3-plugins-config-volume\") pod \"ce345362-f3e5-4560-a60a-384693c0e9f3\" (UID: \"ce345362-f3e5-4560-a60a-384693c0e9f3\") "
Sep 20 01:02:19.697420 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.697397    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ff49d5e-71aa-417f-b5ef-4314c401daa4-plugins-config-volume\") pod \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") "
Sep 20 01:02:19.697502 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.697488    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccw5h\" (UniqueName: \"kubernetes.io/projected/3ff49d5e-71aa-417f-b5ef-4314c401daa4-kube-api-access-ccw5h\") pod \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\" (UID: \"3ff49d5e-71aa-417f-b5ef-4314c401daa4\") "
Sep 20 01:02:19.697749 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.697723    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce345362-f3e5-4560-a60a-384693c0e9f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce345362-f3e5-4560-a60a-384693c0e9f3" (UID: "ce345362-f3e5-4560-a60a-384693c0e9f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:19.697862 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.697802    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce345362-f3e5-4560-a60a-384693c0e9f3-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.697862 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.697830    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ff49d5e-71aa-417f-b5ef-4314c401daa4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ff49d5e-71aa-417f-b5ef-4314c401daa4" (UID: "3ff49d5e-71aa-417f-b5ef-4314c401daa4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:19.699395 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.699371    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce345362-f3e5-4560-a60a-384693c0e9f3-kube-api-access-r5bgc" (OuterVolumeSpecName: "kube-api-access-r5bgc") pod "ce345362-f3e5-4560-a60a-384693c0e9f3" (UID: "ce345362-f3e5-4560-a60a-384693c0e9f3"). InnerVolumeSpecName "kube-api-access-r5bgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:19.699480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.699417    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff49d5e-71aa-417f-b5ef-4314c401daa4-kube-api-access-ccw5h" (OuterVolumeSpecName: "kube-api-access-ccw5h") pod "3ff49d5e-71aa-417f-b5ef-4314c401daa4" (UID: "3ff49d5e-71aa-417f-b5ef-4314c401daa4"). InnerVolumeSpecName "kube-api-access-ccw5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:19.785891 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.785862    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:19.799135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.799108    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5bgc\" (UniqueName: \"kubernetes.io/projected/ce345362-f3e5-4560-a60a-384693c0e9f3-kube-api-access-r5bgc\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.799135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.799130    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ff49d5e-71aa-417f-b5ef-4314c401daa4-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.799326 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.799141    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccw5h\" (UniqueName: \"kubernetes.io/projected/3ff49d5e-71aa-417f-b5ef-4314c401daa4-kube-api-access-ccw5h\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:02:19.884021 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.883988    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"]
Sep 20 01:02:19.884382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884369    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff49d5e-71aa-417f-b5ef-4314c401daa4" containerName="payload-processing"
Sep 20 01:02:19.884435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884384    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff49d5e-71aa-417f-b5ef-4314c401daa4" containerName="payload-processing"
Sep 20 01:02:19.884435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884401    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce345362-f3e5-4560-a60a-384693c0e9f3" containerName="payload-pre-processing"
Sep 20 01:02:19.884435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884406    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce345362-f3e5-4560-a60a-384693c0e9f3" containerName="payload-pre-processing"
Sep 20 01:02:19.884435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884413    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdfb815-defc-4ed2-9d7f-6ae96458efab" containerName="revoke-keys"
Sep 20 01:02:19.884435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884418    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdfb815-defc-4ed2-9d7f-6ae96458efab" containerName="revoke-keys"
Sep 20 01:02:19.884589 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884492    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce345362-f3e5-4560-a60a-384693c0e9f3" containerName="payload-pre-processing"
Sep 20 01:02:19.884589 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884501    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdfb815-defc-4ed2-9d7f-6ae96458efab" containerName="revoke-keys"
Sep 20 01:02:19.884589 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.884507    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff49d5e-71aa-417f-b5ef-4314c401daa4" containerName="payload-processing"
Sep 20 01:02:19.887605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.887587    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:19.890165 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.890098    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"openshift-service-ca.crt\""
Sep 20 01:02:19.890324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.890217    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"kube-root-ca.crt\""
Sep 20 01:02:19.890324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.890286    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"default-dockercfg-xmm6m\""
Sep 20 01:02:19.890437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.890384    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"simulator-w4-4e301e-kserve-self-signed-certs\""
Sep 20 01:02:19.897172 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:19.897149    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"]
Sep 20 01:02:20.001188 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.001164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s5mg\" (UniqueName: \"kubernetes.io/projected/8a8a3d3e-6ee1-4785-879e-8ceff0357076-kube-api-access-7s5mg\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.001306 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.001221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-home\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.001306 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.001247    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-model-cache\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.001306 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.001290    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tmp-dir\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.001430 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.001349    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-dshm\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.001430 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.001373    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tls-certs\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.012352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.012329    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:20.102701 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.102672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tmp-dir\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.102845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.102723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-dshm\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.102845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.102748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tls-certs\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.102845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.102772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s5mg\" (UniqueName: \"kubernetes.io/projected/8a8a3d3e-6ee1-4785-879e-8ceff0357076-kube-api-access-7s5mg\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.102845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.102793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-home\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.102845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.102820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-model-cache\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.103136 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.103116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tmp-dir\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.103265 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.103243    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-model-cache\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.103310 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.103273    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-home\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.105030 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.105009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-dshm\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.105324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.105308    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tls-certs\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.111580 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.111556    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s5mg\" (UniqueName: \"kubernetes.io/projected/8a8a3d3e-6ee1-4785-879e-8ceff0357076-kube-api-access-7s5mg\") pod \"simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") " pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.196721 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.196659    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:20.197576 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.197559    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:20.295142 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.295110    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:20.412270 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.412238    2571 generic.go:356] "Generic (PLEG): container finished" podID="3ff49d5e-71aa-417f-b5ef-4314c401daa4" containerID="5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1" exitCode=0
Sep 20 01:02:20.412727 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.412292    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"
Sep 20 01:02:20.412727 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.412330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc" event={"ID":"3ff49d5e-71aa-417f-b5ef-4314c401daa4","Type":"ContainerDied","Data":"5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1"}
Sep 20 01:02:20.412727 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.412390    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc" event={"ID":"3ff49d5e-71aa-417f-b5ef-4314c401daa4","Type":"ContainerDied","Data":"aaa0e382340bdaaeb16a1bbd65f239ed433028ebb19e83d68adf1905a4ad308e"}
Sep 20 01:02:20.412727 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.412424    2571 scope.go:117] "RemoveContainer" containerID="5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1"
Sep 20 01:02:20.414313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.414288    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce345362-f3e5-4560-a60a-384693c0e9f3" containerID="e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1" exitCode=0
Sep 20 01:02:20.414477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.414348    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"
Sep 20 01:02:20.414477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.414368    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk" event={"ID":"ce345362-f3e5-4560-a60a-384693c0e9f3","Type":"ContainerDied","Data":"e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1"}
Sep 20 01:02:20.414477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.414422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk" event={"ID":"ce345362-f3e5-4560-a60a-384693c0e9f3","Type":"ContainerDied","Data":"0443e8dea2069ed4ca1b75017569b549e49a7e3a2b1ce1519027bff1a5a2fd2e"}
Sep 20 01:02:20.421247 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.421228    2571 scope.go:117] "RemoveContainer" containerID="5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1"
Sep 20 01:02:20.421534 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:02:20.421511    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1\": container with ID starting with 5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1 not found: ID does not exist" containerID="5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1"
Sep 20 01:02:20.421582 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.421546    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1"} err="failed to get container status \"5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1\": rpc error: code = NotFound desc = could not find container \"5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1\": container with ID starting with 5d4d7eac5840d0341ba88972ce50ccd643e8186f8a986d7195174a832e50a8f1 not found: ID does not exist"
Sep 20 01:02:20.421582 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.421569    2571 scope.go:117] "RemoveContainer" containerID="e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1"
Sep 20 01:02:20.429797 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.429780    2571 scope.go:117] "RemoveContainer" containerID="e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1"
Sep 20 01:02:20.430033 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:02:20.430016    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1\": container with ID starting with e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1 not found: ID does not exist" containerID="e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1"
Sep 20 01:02:20.430079 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.430042    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1"} err="failed to get container status \"e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1\": rpc error: code = NotFound desc = could not find container \"e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1\": container with ID starting with e65cb9be29bd925c621be3e21e0dbde1f11a94cc5a7ece0eb6d073c63f5d09b1 not found: ID does not exist"
Sep 20 01:02:20.438342 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.438317    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"]
Sep 20 01:02:20.440088 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.440068    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc"]
Sep 20 01:02:20.455096 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.455039    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"]
Sep 20 01:02:20.465110 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.465091    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk"]
Sep 20 01:02:20.474431 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.474415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"]
Sep 20 01:02:20.477345 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:02:20.477323    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a8a3d3e_6ee1_4785_879e_8ceff0357076.slice/crio-e7fef1ddfb37c5b6ec3179768a813f17c35a35d4a89c423f34cf6388e84aabca WatchSource:0}: Error finding container e7fef1ddfb37c5b6ec3179768a813f17c35a35d4a89c423f34cf6388e84aabca: Status 404 returned error can't find the container with id e7fef1ddfb37c5b6ec3179768a813f17c35a35d4a89c423f34cf6388e84aabca
Sep 20 01:02:20.482968 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.482944    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"]
Sep 20 01:02:20.488472 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.488452    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.491009 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.490988    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-083e5ca1-openshift-default-dockercfg-v9r7z\""
Sep 20 01:02:20.500112 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.500090    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"]
Sep 20 01:02:20.513484 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.513454    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:20.606829 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.606803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv2m6\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-kube-api-access-fv2m6\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.606970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.606846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-certs\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.606970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.606888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c726d74-d587-4079-a12b-853e66ec48a9-istiod-ca-cert\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.606970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.606931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c726d74-d587-4079-a12b-853e66ec48a9-istio-podinfo\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.606970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.606962    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-socket\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.607124 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.607007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-istio-token\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.607124 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.607039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-credential-socket\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.607124 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.607110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-data\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.607274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.607149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-envoy\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708325 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708242    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-credential-socket\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708325 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-data\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708325 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-envoy\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv2m6\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-kube-api-access-fv2m6\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-certs\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c726d74-d587-4079-a12b-853e66ec48a9-istiod-ca-cert\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708588    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c726d74-d587-4079-a12b-853e66ec48a9-istio-podinfo\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-socket\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708665    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-istio-token\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708682    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-credential-socket\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-data\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.708816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.708809    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-certs\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.709102 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.709078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-socket\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.709273 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.709253    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c726d74-d587-4079-a12b-853e66ec48a9-istiod-ca-cert\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.710719 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.710701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-envoy\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.711068 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.711052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c726d74-d587-4079-a12b-853e66ec48a9-istio-podinfo\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.716273 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.716247    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-istio-token\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.716479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.716459    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv2m6\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-kube-api-access-fv2m6\") pod \"e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") " pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.780638 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.780600    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:20.802674 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.802648    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:20.941028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:20.941000    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:21.085237 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.085213    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"]
Sep 20 01:02:21.087332 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:02:21.087307    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c726d74_d587_4079_a12b_853e66ec48a9.slice/crio-aa2fd6f58fec5c41f9e2c0f1db8693e90b787c88199b98f60fb331874d8479d2 WatchSource:0}: Error finding container aa2fd6f58fec5c41f9e2c0f1db8693e90b787c88199b98f60fb331874d8479d2: Status 404 returned error can't find the container with id aa2fd6f58fec5c41f9e2c0f1db8693e90b787c88199b98f60fb331874d8479d2
Sep 20 01:02:21.089628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.089590    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:02:21.089733 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.089657    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:02:21.089733 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.089687    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:02:21.420455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.420375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" event={"ID":"6c726d74-d587-4079-a12b-853e66ec48a9","Type":"ContainerStarted","Data":"0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5"}
Sep 20 01:02:21.420455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.420426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" event={"ID":"6c726d74-d587-4079-a12b-853e66ec48a9","Type":"ContainerStarted","Data":"aa2fd6f58fec5c41f9e2c0f1db8693e90b787c88199b98f60fb331874d8479d2"}
Sep 20 01:02:21.425810 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.425785    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7" event={"ID":"8a8a3d3e-6ee1-4785-879e-8ceff0357076","Type":"ContainerStarted","Data":"80ec7d72e636788ea39df0ecd6d43b2d213ac39df24716f9ade5654b17af2fd2"}
Sep 20 01:02:21.425956 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.425821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7" event={"ID":"8a8a3d3e-6ee1-4785-879e-8ceff0357076","Type":"ContainerStarted","Data":"e7fef1ddfb37c5b6ec3179768a813f17c35a35d4a89c423f34cf6388e84aabca"}
Sep 20 01:02:21.443787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.443741    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" podStartSLOduration=1.4437266819999999 podStartE2EDuration="1.443726682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:02:21.441994248 +0000 UTC m=+888.435269783" watchObservedRunningTime="2026-09-20 01:02:21.443726682 +0000 UTC m=+888.437002205"
Sep 20 01:02:21.460070 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.460034    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7" podStartSLOduration=2.460021893 podStartE2EDuration="2.460021893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:02:21.458933088 +0000 UTC m=+888.452208625" watchObservedRunningTime="2026-09-20 01:02:21.460021893 +0000 UTC m=+888.453297582"
Sep 20 01:02:21.509777 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.509755    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdfb815-defc-4ed2-9d7f-6ae96458efab" path="/var/lib/kubelet/pods/3cdfb815-defc-4ed2-9d7f-6ae96458efab/volumes"
Sep 20 01:02:21.510107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.510095    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff49d5e-71aa-417f-b5ef-4314c401daa4" path="/var/lib/kubelet/pods/3ff49d5e-71aa-417f-b5ef-4314c401daa4/volumes"
Sep 20 01:02:21.510471 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.510457    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce345362-f3e5-4560-a60a-384693c0e9f3" path="/var/lib/kubelet/pods/ce345362-f3e5-4560-a60a-384693c0e9f3/volumes"
Sep 20 01:02:21.613660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.613626    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:21.803570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:21.803537    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:22.432799 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:22.432763    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:22.809349 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:22.809321    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:22.827507 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:22.827478    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:22.924753 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:22.924732    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:23.303489 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:23.303458    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:23.438730 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:23.438704    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:23.439566 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:23.439548    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:24.199075 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:24.199040    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:25.055008 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:25.054976    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:25.157557 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:25.157524    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:25.533449 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:25.533417    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:25.646039 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:25.645999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:25.955137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:25.955044    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:26.617205 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:26.617167    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:02:26.727545 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:26.727511    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:27.736184 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:27.736150    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:28.421016 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:28.420986    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:30.198544 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:30.198511    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:30.198930 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:30.198559    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:30.211094 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:30.211068    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:30.491884 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:30.491807    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:02:34.443088 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:34.443051    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:34.543683 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:34.543656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:44.700651 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:44.700613    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:02:47.237381 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:47.237343    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:47.936982 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:47.936946    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:48.595888 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:48.595858    2571 generic.go:356] "Generic (PLEG): container finished" podID="6c726d74-d587-4079-a12b-853e66ec48a9" containerID="0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5" exitCode=0
Sep 20 01:02:48.596239 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:48.595929    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" event={"ID":"6c726d74-d587-4079-a12b-853e66ec48a9","Type":"ContainerDied","Data":"0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5"}
Sep 20 01:02:48.596384 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:48.596368    2571 scope.go:117] "RemoveContainer" containerID="0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5"
Sep 20 01:02:48.597590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:48.597564    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:02:48.597663 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:48.597634    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:02:48.597699 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:48.597665    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:02:48.819534 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:48.819501    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:49.602686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:49.602651    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" event={"ID":"6c726d74-d587-4079-a12b-853e66ec48a9","Type":"ContainerStarted","Data":"55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2"}
Sep 20 01:02:49.638957 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:49.638922    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:49.802845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:49.802814    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:49.803784 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:49.803761    2571 patch_prober.go:28] interesting pod/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 20 01:02:49.803899 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:49.803811    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 20 01:02:50.433118 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:50.433082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:50.803137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:50.803110    2571 patch_prober.go:28] interesting pod/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 20 01:02:50.803525 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:50.803170    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 20 01:02:51.143065 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:51.142976    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:51.803386 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:51.803349    2571 patch_prober.go:28] interesting pod/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 20 01:02:51.803787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:51.803405    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 20 01:02:51.937586 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:51.937553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:52.729864 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:52.729836    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:52.803620 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:52.803586    2571 patch_prober.go:28] interesting pod/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 20 01:02:52.804065 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:52.803645    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 20 01:02:53.439106 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:53.439062    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:53.519105 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:53.519069    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:53.803352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:53.803320    2571 patch_prober.go:28] interesting pod/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 20 01:02:53.803521 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:53.803381    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 20 01:02:54.332766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:54.332730    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:54.808151 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:54.808119    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:54.809067 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:54.809047    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:02:54.962184 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:54.962137    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:55.036977 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:55.036945    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:55.106395 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:55.106319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:55.186570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:55.186545    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:55.258950 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:55.258923    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:55.703186 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:55.703153    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:56.279828 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:56.279797    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"]
Sep 20 01:02:56.297964 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:56.297936    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:56.401295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:56.401255    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:56.642641 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:56.642547    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy" containerID="cri-o://55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2" gracePeriod=30
Sep 20 01:02:56.730145 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:56.730114    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:57.029833 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:57.029801    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:57.285895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:57.285804    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:57.385460 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:57.385427    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:58.049362 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:58.049322    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:58.976955 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:58.976922    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:59.493806 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:59.493769    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:59.587004 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:59.586977    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:02:59.949453 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:02:59.949426    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:00.693396 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:00.693365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:00.794146 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:00.794117    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:00.894213 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:00.894167    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:01.019612 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.019587    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:03:01.216959 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.216917    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:01.316847 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.316760    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:01.390162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.390129    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"]
Sep 20 01:03:01.392412 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.392391    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.395119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.395100    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f689c4cd-dockercfg-s7npl\""
Sep 20 01:03:01.395230 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.395109    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f689c4cd\""
Sep 20 01:03:01.404044 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.404020    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"]
Sep 20 01:03:01.462550 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.462516    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af101750-4f64-4272-80cc-015654f10fbc-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.462742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.462620    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z458s\" (UniqueName: \"kubernetes.io/projected/af101750-4f64-4272-80cc-015654f10fbc-kube-api-access-z458s\") pod \"payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.563374 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.563342    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z458s\" (UniqueName: \"kubernetes.io/projected/af101750-4f64-4272-80cc-015654f10fbc-kube-api-access-z458s\") pod \"payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.563500 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.563438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af101750-4f64-4272-80cc-015654f10fbc-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.564031 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.564014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af101750-4f64-4272-80cc-015654f10fbc-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.572025 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.571955    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z458s\" (UniqueName: \"kubernetes.io/projected/af101750-4f64-4272-80cc-015654f10fbc-kube-api-access-z458s\") pod \"payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.703023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.702997    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:01.760113 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.760044    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:01.892085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.892060    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:03:01.967328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967304    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c726d74-d587-4079-a12b-853e66ec48a9-istiod-ca-cert\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967447 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967350    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv2m6\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-kube-api-access-fv2m6\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967447 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967381    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-credential-socket\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967447 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967413    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c726d74-d587-4079-a12b-853e66ec48a9-istio-podinfo\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967568 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967518    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-certs\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967568 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967551    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-data\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967667 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967577    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-istio-token\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967667 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-socket\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967667 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-envoy\") pod \"6c726d74-d587-4079-a12b-853e66ec48a9\" (UID: \"6c726d74-d587-4079-a12b-853e66ec48a9\") "
Sep 20 01:03:01.967824 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967663    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:01.967883 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967814    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c726d74-d587-4079-a12b-853e66ec48a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:01.967939 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967858    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:01.967992 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.967952    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:01.968067 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.968049    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:01.968124 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.968072    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:01.968124 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.968088    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:01.968124 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.968102    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c726d74-d587-4079-a12b-853e66ec48a9-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:01.968280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.968165    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:01.969605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.969584    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:01.969714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.969696    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:01.969888 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.969864    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-kube-api-access-fv2m6" (OuterVolumeSpecName: "kube-api-access-fv2m6") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "kube-api-access-fv2m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:01.969888 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.969864    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c726d74-d587-4079-a12b-853e66ec48a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c726d74-d587-4079-a12b-853e66ec48a9" (UID: "6c726d74-d587-4079-a12b-853e66ec48a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:03:01.975636 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:01.975617    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"]
Sep 20 01:03:01.977154 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:03:01.977135    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf101750_4f64_4272_80cc_015654f10fbc.slice/crio-4c0d888fc99387714b8b25db7a4aead30f78ec59929fc604fa4b500006a0cc39 WatchSource:0}: Error finding container 4c0d888fc99387714b8b25db7a4aead30f78ec59929fc604fa4b500006a0cc39: Status 404 returned error can't find the container with id 4c0d888fc99387714b8b25db7a4aead30f78ec59929fc604fa4b500006a0cc39
Sep 20 01:03:02.069397 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.069368    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv2m6\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-kube-api-access-fv2m6\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:02.069397 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.069395    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c726d74-d587-4079-a12b-853e66ec48a9-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:02.069528 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.069404    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:02.069528 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.069413    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c726d74-d587-4079-a12b-853e66ec48a9-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:02.069528 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.069420    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c726d74-d587-4079-a12b-853e66ec48a9-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:02.473952 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.473925    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:02.674864 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.674835    2571 generic.go:356] "Generic (PLEG): container finished" podID="6c726d74-d587-4079-a12b-853e66ec48a9" containerID="55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2" exitCode=0
Sep 20 01:03:02.675004 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.674873    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" event={"ID":"6c726d74-d587-4079-a12b-853e66ec48a9","Type":"ContainerDied","Data":"55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2"}
Sep 20 01:03:02.675004 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.674906    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"
Sep 20 01:03:02.675004 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.674933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh" event={"ID":"6c726d74-d587-4079-a12b-853e66ec48a9","Type":"ContainerDied","Data":"aa2fd6f58fec5c41f9e2c0f1db8693e90b787c88199b98f60fb331874d8479d2"}
Sep 20 01:03:02.675004 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.674963    2571 scope.go:117] "RemoveContainer" containerID="55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2"
Sep 20 01:03:02.676819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.676798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4" event={"ID":"af101750-4f64-4272-80cc-015654f10fbc","Type":"ContainerStarted","Data":"e141400a75ead14804a45b9e645019107903d7da7a98b896f0117d73ab1dc09e"}
Sep 20 01:03:02.676935 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.676841    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4" event={"ID":"af101750-4f64-4272-80cc-015654f10fbc","Type":"ContainerStarted","Data":"4c0d888fc99387714b8b25db7a4aead30f78ec59929fc604fa4b500006a0cc39"}
Sep 20 01:03:02.676990 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.676952    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:02.683821 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.683805    2571 scope.go:117] "RemoveContainer" containerID="0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5"
Sep 20 01:03:02.691832 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.691812    2571 scope.go:117] "RemoveContainer" containerID="55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2"
Sep 20 01:03:02.692092 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:03:02.692073    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2\": container with ID starting with 55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2 not found: ID does not exist" containerID="55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2"
Sep 20 01:03:02.692169 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.692104    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2"} err="failed to get container status \"55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2\": rpc error: code = NotFound desc = could not find container \"55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2\": container with ID starting with 55c62e2e9aa2a443da5ca98f86d9faea544d1dd8957927f0e06868c223a9d2f2 not found: ID does not exist"
Sep 20 01:03:02.692169 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.692127    2571 scope.go:117] "RemoveContainer" containerID="0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5"
Sep 20 01:03:02.692397 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:03:02.692380    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5\": container with ID starting with 0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5 not found: ID does not exist" containerID="0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5"
Sep 20 01:03:02.692437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.692402    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5"} err="failed to get container status \"0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5\": rpc error: code = NotFound desc = could not find container \"0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5\": container with ID starting with 0a950fa03e972f1dd4cf0c834de816ef19d7d9d5b535a12aaad3fadba3320dd5 not found: ID does not exist"
Sep 20 01:03:02.699685 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.699645    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4" podStartSLOduration=1.699629762 podStartE2EDuration="1.699629762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:03:02.69740512 +0000 UTC m=+929.690680654" watchObservedRunningTime="2026-09-20 01:03:02.699629762 +0000 UTC m=+929.692905300"
Sep 20 01:03:02.712801 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.712781    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"]
Sep 20 01:03:02.716922 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:02.716904    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh"]
Sep 20 01:03:03.206242 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:03.206209    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:03.509628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:03.509593    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" path="/var/lib/kubelet/pods/6c726d74-d587-4079-a12b-853e66ec48a9/volumes"
Sep 20 01:03:04.052266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:04.052239    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:04.894914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:04.894874    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:08.286105 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.286067    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"]
Sep 20 01:03:08.286638 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.286452    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy"
Sep 20 01:03:08.286638 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.286465    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy"
Sep 20 01:03:08.286638 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.286546    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy"
Sep 20 01:03:08.286638 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.286556    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy"
Sep 20 01:03:08.289315 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.289298    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.291912 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.291889    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-173fde\"/\"openshift-service-ca.crt\""
Sep 20 01:03:08.293052 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.293008    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-173fde\"/\"kube-root-ca.crt\""
Sep 20 01:03:08.293258 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.293053    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-173fde\"/\"autores-model-173fde-kserve-self-signed-certs\""
Sep 20 01:03:08.293258 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.293099    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-173fde\"/\"default-dockercfg-vn825\""
Sep 20 01:03:08.299851 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.299823    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"]
Sep 20 01:03:08.324183 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.324158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tls-certs\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.324311 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.324187    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-dshm\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.324311 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.324221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-model-cache\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.324432 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.324320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svhdx\" (UniqueName: \"kubernetes.io/projected/f91a4d90-9b4d-4256-9134-1e32f911b9dc-kube-api-access-svhdx\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.324432 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.324366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tmp-dir\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.324545 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.324444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-home\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.396528 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.396503    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:08.425873 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.425852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tmp-dir\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.425981 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.425899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-home\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.425981 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.425948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tls-certs\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.425981 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.425965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-dshm\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.425981 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.425980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-model-cache\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.426220 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.426114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svhdx\" (UniqueName: \"kubernetes.io/projected/f91a4d90-9b4d-4256-9134-1e32f911b9dc-kube-api-access-svhdx\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.426313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.426293    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tmp-dir\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.426382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.426310    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-home\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.426382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.426372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-model-cache\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.428245 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.428230    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-dshm\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.428328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.428312    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tls-certs\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.433880 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.433859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svhdx\" (UniqueName: \"kubernetes.io/projected/f91a4d90-9b4d-4256-9134-1e32f911b9dc-kube-api-access-svhdx\") pod \"autores-model-173fde-kserve-79bb69545f-fczgp\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") " pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.600288 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.600236    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:08.872008 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:08.871976    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"]
Sep 20 01:03:08.873560 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:03:08.873533    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf91a4d90_9b4d_4256_9134_1e32f911b9dc.slice/crio-f61813405c172d6599236ab942e8c425f0f0c8f34a1ce71454170a620b1eafe0 WatchSource:0}: Error finding container f61813405c172d6599236ab942e8c425f0f0c8f34a1ce71454170a620b1eafe0: Status 404 returned error can't find the container with id f61813405c172d6599236ab942e8c425f0f0c8f34a1ce71454170a620b1eafe0
Sep 20 01:03:09.716159 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:09.716126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp" event={"ID":"f91a4d90-9b4d-4256-9134-1e32f911b9dc","Type":"ContainerStarted","Data":"fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c"}
Sep 20 01:03:09.716654 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:09.716169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp" event={"ID":"f91a4d90-9b4d-4256-9134-1e32f911b9dc","Type":"ContainerStarted","Data":"f61813405c172d6599236ab942e8c425f0f0c8f34a1ce71454170a620b1eafe0"}
Sep 20 01:03:09.733940 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:09.733898    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp" podStartSLOduration=1.733883925 podStartE2EDuration="1.733883925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:03:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:03:09.732355117 +0000 UTC m=+936.725630651" watchObservedRunningTime="2026-09-20 01:03:09.733883925 +0000 UTC m=+936.727159457"
Sep 20 01:03:13.685121 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:13.685080    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:14.592976 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.592941    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"]
Sep 20 01:03:14.593374 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.593360    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy"
Sep 20 01:03:14.593429 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.593377    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c726d74-d587-4079-a12b-853e66ec48a9" containerName="istio-proxy"
Sep 20 01:03:14.595530 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.595512    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.599404 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.599381    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2fd525\"/\"test-model-2fd525-kserve-self-signed-certs\""
Sep 20 01:03:14.599404 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.599398    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2fd525\"/\"default-dockercfg-d5tsj\""
Sep 20 01:03:14.599587 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.599387    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2fd525\"/\"openshift-service-ca.crt\""
Sep 20 01:03:14.599649 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.599614    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2fd525\"/\"kube-root-ca.crt\""
Sep 20 01:03:14.605104 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.605082    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"]
Sep 20 01:03:14.619472 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.619450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:14.685235 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.685188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-tmp-dir\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.685539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.685244    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-model-cache\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.685539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.685326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd41336f-cd40-416d-a8d7-cca7849d9430-tls-certs\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.685539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.685356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtnqq\" (UniqueName: \"kubernetes.io/projected/dd41336f-cd40-416d-a8d7-cca7849d9430-kube-api-access-rtnqq\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.685539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.685385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-dshm\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.685539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.685413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-home\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.787029 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.786987    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd41336f-cd40-416d-a8d7-cca7849d9430-tls-certs\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.787264 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.787054    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtnqq\" (UniqueName: \"kubernetes.io/projected/dd41336f-cd40-416d-a8d7-cca7849d9430-kube-api-access-rtnqq\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.787264 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.787098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-dshm\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.787264 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.787131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-home\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.788074 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.787265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-tmp-dir\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.788074 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.787296    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-model-cache\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.788074 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.787746    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-model-cache\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.788516 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.788186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-home\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.788516 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.788462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-tmp-dir\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.790762 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.790675    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd41336f-cd40-416d-a8d7-cca7849d9430-tls-certs\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.790886 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.790852    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-dshm\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.796502 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.796475    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtnqq\" (UniqueName: \"kubernetes.io/projected/dd41336f-cd40-416d-a8d7-cca7849d9430-kube-api-access-rtnqq\") pod \"test-model-2fd525-kserve-dcbdd6f65-zmt5z\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") " pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:14.906348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:14.906284    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:15.178739 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:15.178710    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"]
Sep 20 01:03:15.180380 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:03:15.180354    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd41336f_cd40_416d_a8d7_cca7849d9430.slice/crio-a794e97d8a1514be827c3228a1b39b0cbf8af14882145cd48688bb258b30355e WatchSource:0}: Error finding container a794e97d8a1514be827c3228a1b39b0cbf8af14882145cd48688bb258b30355e: Status 404 returned error can't find the container with id a794e97d8a1514be827c3228a1b39b0cbf8af14882145cd48688bb258b30355e
Sep 20 01:03:15.751222 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:15.751178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z" event={"ID":"dd41336f-cd40-416d-a8d7-cca7849d9430","Type":"ContainerStarted","Data":"60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491"}
Sep 20 01:03:15.751222 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:15.751224    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z" event={"ID":"dd41336f-cd40-416d-a8d7-cca7849d9430","Type":"ContainerStarted","Data":"a794e97d8a1514be827c3228a1b39b0cbf8af14882145cd48688bb258b30355e"}
Sep 20 01:03:15.768548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:15.768501    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z" podStartSLOduration=1.76848593 podStartE2EDuration="1.76848593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:03:15.76673234 +0000 UTC m=+942.760007873" watchObservedRunningTime="2026-09-20 01:03:15.76848593 +0000 UTC m=+942.761761463"
Sep 20 01:03:18.600880 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:18.600840    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:18.600880 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:18.600893    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:18.613183 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:18.613161    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:18.777132 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:18.777109    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:03:22.807304 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:22.807248    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:23.725781 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:23.725745    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:24.630680 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:24.630634    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:24.906702 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:24.906622    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:24.906702 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:24.906674    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:24.919299 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:24.919271    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:25.331381 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:25.331351    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:25.509592 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:25.509564    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:03:25.810874 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:25.810836    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:03:26.211014 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:26.210933    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:27.042358 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:27.042314    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:27.746889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:27.746852    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:28.542620 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:28.542590    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:29.346369 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:29.346324    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:30.968594 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:30.968554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:31.608363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.608330    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:31.651118 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.651090    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"]
Sep 20 01:03:31.651355 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.651330    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4" podUID="af101750-4f64-4272-80cc-015654f10fbc" containerName="payload-pre-processing" containerID="cri-o://e141400a75ead14804a45b9e645019107903d7da7a98b896f0117d73ab1dc09e" gracePeriod=30
Sep 20 01:03:31.680555 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.680529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:31.778715 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.778684    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:31.834486 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.834461    2571 generic.go:356] "Generic (PLEG): container finished" podID="af101750-4f64-4272-80cc-015654f10fbc" containerID="e141400a75ead14804a45b9e645019107903d7da7a98b896f0117d73ab1dc09e" exitCode=0
Sep 20 01:03:31.834607 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.834536    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4" event={"ID":"af101750-4f64-4272-80cc-015654f10fbc","Type":"ContainerDied","Data":"e141400a75ead14804a45b9e645019107903d7da7a98b896f0117d73ab1dc09e"}
Sep 20 01:03:31.846377 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.846314    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:31.904069 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.904049    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:31.981544 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:31.981517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:32.031903 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.031880    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z458s\" (UniqueName: \"kubernetes.io/projected/af101750-4f64-4272-80cc-015654f10fbc-kube-api-access-z458s\") pod \"af101750-4f64-4272-80cc-015654f10fbc\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") "
Sep 20 01:03:32.032014 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.031919    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af101750-4f64-4272-80cc-015654f10fbc-plugins-config-volume\") pod \"af101750-4f64-4272-80cc-015654f10fbc\" (UID: \"af101750-4f64-4272-80cc-015654f10fbc\") "
Sep 20 01:03:32.032345 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.032323    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af101750-4f64-4272-80cc-015654f10fbc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af101750-4f64-4272-80cc-015654f10fbc" (UID: "af101750-4f64-4272-80cc-015654f10fbc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:32.033978 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.033959    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af101750-4f64-4272-80cc-015654f10fbc-kube-api-access-z458s" (OuterVolumeSpecName: "kube-api-access-z458s") pod "af101750-4f64-4272-80cc-015654f10fbc" (UID: "af101750-4f64-4272-80cc-015654f10fbc"). InnerVolumeSpecName "kube-api-access-z458s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:32.133640 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.133608    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z458s\" (UniqueName: \"kubernetes.io/projected/af101750-4f64-4272-80cc-015654f10fbc-kube-api-access-z458s\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.133640 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.133635    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af101750-4f64-4272-80cc-015654f10fbc-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.219978 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.219909    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:32.444989 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.444952    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:32.549598 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.549544    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:32.660697 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.660671    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:32.823662 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.823604    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:32.840846 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.840824    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"
Sep 20 01:03:32.840949 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.840866    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4" event={"ID":"af101750-4f64-4272-80cc-015654f10fbc","Type":"ContainerDied","Data":"4c0d888fc99387714b8b25db7a4aead30f78ec59929fc604fa4b500006a0cc39"}
Sep 20 01:03:32.840949 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.840929    2571 scope.go:117] "RemoveContainer" containerID="e141400a75ead14804a45b9e645019107903d7da7a98b896f0117d73ab1dc09e"
Sep 20 01:03:32.864120 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.864097    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"]
Sep 20 01:03:32.867738 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:32.867719    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4"]
Sep 20 01:03:33.151611 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:33.151545    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:33.511332 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:33.511299    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af101750-4f64-4272-80cc-015654f10fbc" path="/var/lib/kubelet/pods/af101750-4f64-4272-80cc-015654f10fbc/volumes"
Sep 20 01:03:33.842090 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:33.842022    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:34.139284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:34.139180    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:34.597037 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:34.596998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:35.275015 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:35.274980    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:36.123759 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:36.123724    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:36.831758 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:36.831725    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:39.965604 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:39.965558    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:40.070454 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:40.070420    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:40.164522 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:40.164497    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:40.276703 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:40.276672    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:40.668161 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:40.668084    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:42.586267 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:42.586231    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:42.999385 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:42.999353    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:03:43.508113 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:43.508080    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:44.211251 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:44.211217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:45.020070 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:45.020041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:45.720610 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:45.720576    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:46.398468 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:46.398428    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:47.164540 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:47.164509    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:47.401341 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:47.401243    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"]
Sep 20 01:03:47.419365 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:47.419246    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:52.708419 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:52.708384    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:52.778910 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:52.778875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:52.831441 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:52.831406    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:52.911630 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:52.911600    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:52.970847 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:52.970768    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:53.149098 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:53.149064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:53.263409 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:53.263374    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:53.843082 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:53.843048    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:54.542975 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:54.542943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:55.342167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:55.342126    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:56.034893 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:56.034812    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:58.343134 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:58.343094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:59.108698 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:59.108656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:03:59.158915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:03:59.158877    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:02.421732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.421671    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp" podUID="f91a4d90-9b4d-4256-9134-1e32f911b9dc" containerName="main" containerID="cri-o://fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c" gracePeriod=45
Sep 20 01:04:02.661922 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.661896    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:04:02.696314 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696248    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svhdx\" (UniqueName: \"kubernetes.io/projected/f91a4d90-9b4d-4256-9134-1e32f911b9dc-kube-api-access-svhdx\") pod \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") "
Sep 20 01:04:02.696427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696335    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-dshm\") pod \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") "
Sep 20 01:04:02.696427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696387    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tls-certs\") pod \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") "
Sep 20 01:04:02.696427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696424    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tmp-dir\") pod \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") "
Sep 20 01:04:02.696585 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696451    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-model-cache\") pod \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") "
Sep 20 01:04:02.696585 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696511    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-home\") pod \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\" (UID: \"f91a4d90-9b4d-4256-9134-1e32f911b9dc\") "
Sep 20 01:04:02.696811 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696748    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f91a4d90-9b4d-4256-9134-1e32f911b9dc" (UID: "f91a4d90-9b4d-4256-9134-1e32f911b9dc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:02.696955 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.696810    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-model-cache" (OuterVolumeSpecName: "model-cache") pod "f91a4d90-9b4d-4256-9134-1e32f911b9dc" (UID: "f91a4d90-9b4d-4256-9134-1e32f911b9dc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:02.697039 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.697016    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-home" (OuterVolumeSpecName: "home") pod "f91a4d90-9b4d-4256-9134-1e32f911b9dc" (UID: "f91a4d90-9b4d-4256-9134-1e32f911b9dc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:02.698505 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.698478    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-dshm" (OuterVolumeSpecName: "dshm") pod "f91a4d90-9b4d-4256-9134-1e32f911b9dc" (UID: "f91a4d90-9b4d-4256-9134-1e32f911b9dc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:02.698604 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.698511    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f91a4d90-9b4d-4256-9134-1e32f911b9dc-kube-api-access-svhdx" (OuterVolumeSpecName: "kube-api-access-svhdx") pod "f91a4d90-9b4d-4256-9134-1e32f911b9dc" (UID: "f91a4d90-9b4d-4256-9134-1e32f911b9dc"). InnerVolumeSpecName "kube-api-access-svhdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:04:02.698604 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.698583    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f91a4d90-9b4d-4256-9134-1e32f911b9dc" (UID: "f91a4d90-9b4d-4256-9134-1e32f911b9dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:04:02.797550 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.797523    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:02.797550 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.797548    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:02.797689 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.797561    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:02.797689 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.797572    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:02.797689 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.797584    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svhdx\" (UniqueName: \"kubernetes.io/projected/f91a4d90-9b4d-4256-9134-1e32f911b9dc-kube-api-access-svhdx\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:02.797689 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.797595    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f91a4d90-9b4d-4256-9134-1e32f911b9dc-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:02.894660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:02.894633    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:04:03.005312 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.005279    2571 generic.go:356] "Generic (PLEG): container finished" podID="f91a4d90-9b4d-4256-9134-1e32f911b9dc" containerID="fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c" exitCode=0
Sep 20 01:04:03.005469 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.005332    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"
Sep 20 01:04:03.005469 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.005359    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp" event={"ID":"f91a4d90-9b4d-4256-9134-1e32f911b9dc","Type":"ContainerDied","Data":"fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c"}
Sep 20 01:04:03.005469 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.005406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp" event={"ID":"f91a4d90-9b4d-4256-9134-1e32f911b9dc","Type":"ContainerDied","Data":"f61813405c172d6599236ab942e8c425f0f0c8f34a1ce71454170a620b1eafe0"}
Sep 20 01:04:03.005469 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.005428    2571 scope.go:117] "RemoveContainer" containerID="fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c"
Sep 20 01:04:03.014405 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.014386    2571 scope.go:117] "RemoveContainer" containerID="fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c"
Sep 20 01:04:03.014654 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:04:03.014635    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c\": container with ID starting with fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c not found: ID does not exist" containerID="fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c"
Sep 20 01:04:03.014701 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.014662    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c"} err="failed to get container status \"fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c\": rpc error: code = NotFound desc = could not find container \"fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c\": container with ID starting with fa0ecd7c24b6745d4e7c55a2f42f1bddfc4e9c77571ba15af038534efe8f7a7c not found: ID does not exist"
Sep 20 01:04:03.026366 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.026345    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"]
Sep 20 01:04:03.031410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.031389    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-173fde/autores-model-173fde-kserve-79bb69545f-fczgp"]
Sep 20 01:04:03.510095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:03.510062    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f91a4d90-9b4d-4256-9134-1e32f911b9dc" path="/var/lib/kubelet/pods/f91a4d90-9b4d-4256-9134-1e32f911b9dc/volumes"
Sep 20 01:04:04.052889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:04.052853    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:04.290182 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:04.290151    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"]
Sep 20 01:04:04.290437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:04.290410    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy" containerID="cri-o://275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda" gracePeriod=30
Sep 20 01:04:04.306854 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:04.306799    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:04.744260 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:04.744170    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:05.064623 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:05.064591    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:05.191403 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:05.191364    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:06.532382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:06.532346    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:07.691171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:07.691134    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:08.316614 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:08.316585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:08.420182 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:08.420149    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:08.636024 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:08.635947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:09.364664 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.364636    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:09.547577 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.547554    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:04:09.653103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653046    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-token\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653101    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psd4d\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-kube-api-access-psd4d\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653148    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-credential-socket\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653176    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-certs\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653222    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-podinfo\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653253    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-envoy\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653296    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-socket\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653318    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-data\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653347    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istiod-ca-cert\") pod \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\" (UID: \"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f\") "
Sep 20 01:04:09.653553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653414    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:09.653553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653470    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:09.653739 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653566    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:09.653739 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653664    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:09.653821 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653780    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:04:09.653821 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653787    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.653912 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653823    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.653912 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653840    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.653912 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.653853    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.655143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.655123    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:04:09.655620 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.655590    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-kube-api-access-psd4d" (OuterVolumeSpecName: "kube-api-access-psd4d") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "kube-api-access-psd4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:04:09.655702 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.655650    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:04:09.655780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.655712    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" (UID: "5b041eab-eaa8-4ed4-9b32-04e7cf68b63f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:04:09.755295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.755266    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.755295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.755293    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.755417 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.755302    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.755417 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.755310    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psd4d\" (UniqueName: \"kubernetes.io/projected/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-kube-api-access-psd4d\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:09.755417 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:09.755321    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:04:10.046166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.046136    2571 generic.go:356] "Generic (PLEG): container finished" podID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerID="275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda" exitCode=0
Sep 20 01:04:10.046284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.046214    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"
Sep 20 01:04:10.046284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.046235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" event={"ID":"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f","Type":"ContainerDied","Data":"275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda"}
Sep 20 01:04:10.046382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.046302    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p" event={"ID":"5b041eab-eaa8-4ed4-9b32-04e7cf68b63f","Type":"ContainerDied","Data":"4431b41f351ffde93d3bdd49be5b68ca575e17c8b595b77330db8cd04f554f18"}
Sep 20 01:04:10.046382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.046344    2571 scope.go:117] "RemoveContainer" containerID="275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda"
Sep 20 01:04:10.055818 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.055803    2571 scope.go:117] "RemoveContainer" containerID="cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb"
Sep 20 01:04:10.064083 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.064066    2571 scope.go:117] "RemoveContainer" containerID="275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda"
Sep 20 01:04:10.064355 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:04:10.064337    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda\": container with ID starting with 275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda not found: ID does not exist" containerID="275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda"
Sep 20 01:04:10.064416 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.064362    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda"} err="failed to get container status \"275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda\": rpc error: code = NotFound desc = could not find container \"275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda\": container with ID starting with 275efc87aa4b95c79dc4c67f57726447a9d96f9bfc9fb3654a6014d337bc9eda not found: ID does not exist"
Sep 20 01:04:10.064416 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.064377    2571 scope.go:117] "RemoveContainer" containerID="cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb"
Sep 20 01:04:10.064604 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:04:10.064588    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb\": container with ID starting with cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb not found: ID does not exist" containerID="cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb"
Sep 20 01:04:10.064650 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.064608    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb"} err="failed to get container status \"cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb\": rpc error: code = NotFound desc = could not find container \"cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb\": container with ID starting with cc994fcd54337f94df5e4abfb6034e8ae73449ddefdf8e5c26ffc936c37b0cbb not found: ID does not exist"
Sep 20 01:04:10.068470 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.068447    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"]
Sep 20 01:04:10.072162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.072136    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p"]
Sep 20 01:04:10.198452 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:10.198422    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:11.156945 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:11.156908    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:11.509434 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:11.509406    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" path="/var/lib/kubelet/pods/5b041eab-eaa8-4ed4-9b32-04e7cf68b63f/volumes"
Sep 20 01:04:11.875318 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:11.875245    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:11.939629 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:11.939602    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:12.051622 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:12.051595    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:12.354615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:12.354588    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:12.443664 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:12.443638    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:12.964037 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:12.963978    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:13.063621 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:13.063592    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:13.139263 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:13.139184    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:19.710072 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:19.710039    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:04:23.991644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.991611    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"]
Sep 20 01:04:23.992018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.991984    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af101750-4f64-4272-80cc-015654f10fbc" containerName="payload-pre-processing"
Sep 20 01:04:23.992018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.991999    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="af101750-4f64-4272-80cc-015654f10fbc" containerName="payload-pre-processing"
Sep 20 01:04:23.992018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992016    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy"
Sep 20 01:04:23.992119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992021    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy"
Sep 20 01:04:23.992119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992028    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy"
Sep 20 01:04:23.992119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992033    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy"
Sep 20 01:04:23.992119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992042    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91a4d90-9b4d-4256-9134-1e32f911b9dc" containerName="main"
Sep 20 01:04:23.992119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992049    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91a4d90-9b4d-4256-9134-1e32f911b9dc" containerName="main"
Sep 20 01:04:23.992119 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992115    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy"
Sep 20 01:04:23.992328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992123    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="af101750-4f64-4272-80cc-015654f10fbc" containerName="payload-pre-processing"
Sep 20 01:04:23.992328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992130    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b041eab-eaa8-4ed4-9b32-04e7cf68b63f" containerName="istio-proxy"
Sep 20 01:04:23.992328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.992139    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91a4d90-9b4d-4256-9134-1e32f911b9dc" containerName="main"
Sep 20 01:04:23.995078 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.995055    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:23.997783 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:23.997758    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"premium-w0-e2e8bc-kserve-self-signed-certs\""
Sep 20 01:04:24.004309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.004284    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"]
Sep 20 01:04:24.016115 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.016075    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:24.072322 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.072298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-home\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.072410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.072327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-tmp-dir\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.072410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.072356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-model-cache\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.072410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.072400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61126d66-731e-4c4e-8330-68633cae6e85-tls-certs\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.072523 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.072473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-dshm\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.072523 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.072506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64dq7\" (UniqueName: \"kubernetes.io/projected/61126d66-731e-4c4e-8330-68633cae6e85-kube-api-access-64dq7\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173046 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-model-cache\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173178 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61126d66-731e-4c4e-8330-68633cae6e85-tls-certs\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173178 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-dshm\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173178 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dq7\" (UniqueName: \"kubernetes.io/projected/61126d66-731e-4c4e-8330-68633cae6e85-kube-api-access-64dq7\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-home\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-tmp-dir\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173492 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-model-cache\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173535 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173504    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-home\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.173611 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.173594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-tmp-dir\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.175509 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.175473    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-dshm\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.175601 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.175569    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61126d66-731e-4c4e-8330-68633cae6e85-tls-certs\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.180962 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.180944    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dq7\" (UniqueName: \"kubernetes.io/projected/61126d66-731e-4c4e-8330-68633cae6e85-kube-api-access-64dq7\") pod \"premium-w0-e2e8bc-kserve-84f98f89f-gzskk\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") " pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.305268 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.305238    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:24.573263 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:24.573237    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"]
Sep 20 01:04:24.575392 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:04:24.575363    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61126d66_731e_4c4e_8330_68633cae6e85.slice/crio-cc645c0afffb8b2c43c7993401121d502cf975d2fbbc58e426f49da694e40390 WatchSource:0}: Error finding container cc645c0afffb8b2c43c7993401121d502cf975d2fbbc58e426f49da694e40390: Status 404 returned error can't find the container with id cc645c0afffb8b2c43c7993401121d502cf975d2fbbc58e426f49da694e40390
Sep 20 01:04:25.119692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:25.119651    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk" event={"ID":"61126d66-731e-4c4e-8330-68633cae6e85","Type":"ContainerStarted","Data":"de94148e5a55b723464f3b3e49971ecd867548b34d5b9603e81bb1b6ba211a5f"}
Sep 20 01:04:25.120085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:25.119699    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk" event={"ID":"61126d66-731e-4c4e-8330-68633cae6e85","Type":"ContainerStarted","Data":"cc645c0afffb8b2c43c7993401121d502cf975d2fbbc58e426f49da694e40390"}
Sep 20 01:04:25.136985 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:25.136936    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk" podStartSLOduration=2.136918146 podStartE2EDuration="2.136918146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:04:25.135544519 +0000 UTC m=+1012.128820052" watchObservedRunningTime="2026-09-20 01:04:25.136918146 +0000 UTC m=+1012.130193682"
Sep 20 01:04:28.995168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:28.995121    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:32.501853 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:32.501818    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:33.843229 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:33.843127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:34.305634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:34.305604    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:34.305869 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:34.305846    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:34.318087 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:34.318062    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:34.646577 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:34.646506    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:35.180448 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:35.180422    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:04:35.353966 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:35.353932    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:35.511098 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:35.511060    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:35.615145 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:35.615113    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:35.712725 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:35.712696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:36.326894 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:36.326864    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:37.036245 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.036184    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:37.694655 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.694625    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"]
Sep 20 01:04:37.699242 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.699219    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.703161 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.703130    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-376bcf\"/\"openshift-service-ca.crt\""
Sep 20 01:04:37.703161 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.703130    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-376bcf\"/\"test-model-376bcf-kserve-self-signed-certs\""
Sep 20 01:04:37.703353 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.703136    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-376bcf\"/\"kube-root-ca.crt\""
Sep 20 01:04:37.703353 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.703218    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-376bcf\"/\"default-dockercfg-5ts5r\""
Sep 20 01:04:37.708362 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.708341    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"]
Sep 20 01:04:37.727503 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.727477    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:37.788094 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.788070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvtrt\" (UniqueName: \"kubernetes.io/projected/4e23e195-c32c-4f44-b14b-0763b8243ae2-kube-api-access-lvtrt\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.788216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.788105    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-model-cache\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.788216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.788144    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-dshm\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.788216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.788170    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-home\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.788331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.788222    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e23e195-c32c-4f44-b14b-0763b8243ae2-tls-certs\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.788331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.788238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-tmp-dir\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.828359 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.828334    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:37.889011 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.888982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-model-cache\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889157 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-dshm\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889157 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-home\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889157 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e23e195-c32c-4f44-b14b-0763b8243ae2-tls-certs\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889157 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-tmp-dir\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889405 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvtrt\" (UniqueName: \"kubernetes.io/projected/4e23e195-c32c-4f44-b14b-0763b8243ae2-kube-api-access-lvtrt\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889487    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-model-cache\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889576 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-home\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.889627 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.889571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-tmp-dir\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.891438 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.891408    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-dshm\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.891679 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.891661    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e23e195-c32c-4f44-b14b-0763b8243ae2-tls-certs\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:37.897385 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:37.897362    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvtrt\" (UniqueName: \"kubernetes.io/projected/4e23e195-c32c-4f44-b14b-0763b8243ae2-kube-api-access-lvtrt\") pod \"test-model-376bcf-kserve-55ccb9c7dc-jwslh\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") " pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:38.010379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:38.010354    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:38.281314 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:38.281290    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"]
Sep 20 01:04:38.282922 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:04:38.282895    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e23e195_c32c_4f44_b14b_0763b8243ae2.slice/crio-71f3a6103500505c3e87915abf5f634a7366c465c39e4c95610b89656b38b0bc WatchSource:0}: Error finding container 71f3a6103500505c3e87915abf5f634a7366c465c39e4c95610b89656b38b0bc: Status 404 returned error can't find the container with id 71f3a6103500505c3e87915abf5f634a7366c465c39e4c95610b89656b38b0bc
Sep 20 01:04:38.350971 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:38.350945    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:39.191171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:39.191136    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh" event={"ID":"4e23e195-c32c-4f44-b14b-0763b8243ae2","Type":"ContainerStarted","Data":"e0173a7958e298a66e42e9073930375889967c6801de4a9016d38de53d51295a"}
Sep 20 01:04:39.191171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:39.191177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh" event={"ID":"4e23e195-c32c-4f44-b14b-0763b8243ae2","Type":"ContainerStarted","Data":"71f3a6103500505c3e87915abf5f634a7366c465c39e4c95610b89656b38b0bc"}
Sep 20 01:04:39.206997 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:39.206942    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh" podStartSLOduration=2.206922386 podStartE2EDuration="2.206922386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:04:39.206603792 +0000 UTC m=+1026.199879317" watchObservedRunningTime="2026-09-20 01:04:39.206922386 +0000 UTC m=+1026.200197922"
Sep 20 01:04:44.194580 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:44.194547    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:04:46.191222 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:46.191166    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:46.937979 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:46.937944    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:48.010532 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:48.010493    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:48.011072 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:48.010555    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:48.023470 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:48.023438    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:48.265061 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:48.264988    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:04:52.679482 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:52.679429    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:52.786357 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:52.786318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:52.879641 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:52.879608    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:52.979488 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:52.979408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:53.576862 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:53.576829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:53.679802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:53.679778    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:53.783007 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:53.782972    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:04:55.187026 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:04:55.186990    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:01.200385 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.200355    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"]
Sep 20 01:05:01.203513 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.203498    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.207038 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.207005    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-7db579\"/\"explicit-model-7db579-kserve-self-signed-certs\""
Sep 20 01:05:01.207038 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.207022    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-7db579\"/\"default-dockercfg-9fxc6\""
Sep 20 01:05:01.207038 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.207037    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-7db579\"/\"kube-root-ca.crt\""
Sep 20 01:05:01.207314 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.207007    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-7db579\"/\"openshift-service-ca.crt\""
Sep 20 01:05:01.214038 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.214007    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"]
Sep 20 01:05:01.289230 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.289175    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce9242f-e312-4d67-9664-ebf39429d70d-tls-certs\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.289389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.289313    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-dshm\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.289389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.289343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-tmp-dir\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.289497 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.289396    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-model-cache\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.289497 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.289448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-home\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.289497 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.289473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvj5x\" (UniqueName: \"kubernetes.io/projected/6ce9242f-e312-4d67-9664-ebf39429d70d-kube-api-access-wvj5x\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.290553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.290529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:01.390144 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-dshm\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390304 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390148    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-tmp-dir\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390304 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390184    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-model-cache\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390304 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390272    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-home\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390304 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390297    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvj5x\" (UniqueName: \"kubernetes.io/projected/6ce9242f-e312-4d67-9664-ebf39429d70d-kube-api-access-wvj5x\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390521 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390359    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce9242f-e312-4d67-9664-ebf39429d70d-tls-certs\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390597 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390576    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-model-cache\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390672 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390651    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-tmp-dir\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.390717 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.390669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-home\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.392548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.392527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-dshm\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.392835 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.392817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce9242f-e312-4d67-9664-ebf39429d70d-tls-certs\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.398168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.398147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvj5x\" (UniqueName: \"kubernetes.io/projected/6ce9242f-e312-4d67-9664-ebf39429d70d-kube-api-access-wvj5x\") pod \"explicit-model-7db579-kserve-76bb75b549-x96d4\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") " pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.514167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.514138    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:01.785708 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.785656    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"]
Sep 20 01:05:01.787948 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:05:01.787920    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ce9242f_e312_4d67_9664_ebf39429d70d.slice/crio-497a82cbad090437d1d3addd2b29fbaf5df39a6cd7bb6f9a3a1731cf7b43c6c8 WatchSource:0}: Error finding container 497a82cbad090437d1d3addd2b29fbaf5df39a6cd7bb6f9a3a1731cf7b43c6c8: Status 404 returned error can't find the container with id 497a82cbad090437d1d3addd2b29fbaf5df39a6cd7bb6f9a3a1731cf7b43c6c8
Sep 20 01:05:01.826310 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.826269    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:01.930512 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:01.930472    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:02.327735 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:02.327703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4" event={"ID":"6ce9242f-e312-4d67-9664-ebf39429d70d","Type":"ContainerStarted","Data":"80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3"}
Sep 20 01:05:02.328100 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:02.327744    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4" event={"ID":"6ce9242f-e312-4d67-9664-ebf39429d70d","Type":"ContainerStarted","Data":"497a82cbad090437d1d3addd2b29fbaf5df39a6cd7bb6f9a3a1731cf7b43c6c8"}
Sep 20 01:05:02.347734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:02.347677    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4" podStartSLOduration=1.3476573840000001 podStartE2EDuration="1.347657384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:02.344578188 +0000 UTC m=+1049.337853723" watchObservedRunningTime="2026-09-20 01:05:02.347657384 +0000 UTC m=+1049.340932919"
Sep 20 01:05:02.477057 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:02.477029    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:08.360879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:08.360800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:08.461637 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:08.461605    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:08.584155 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:08.584125    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:08.871018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:08.870984    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:09.506478 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:09.506445    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:11.514964 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:11.514931    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:11.515375 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:11.514985    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:11.527585 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:11.527561    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:12.392530 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:12.392500    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:13.744531 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:13.744495    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:14.448174 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:14.448140    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:14.544769 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:14.544737    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:15.363563 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:15.363530    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:16.144642 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:16.144603    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:16.839648 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:16.839590    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:17.584520 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:17.584483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:18.002713 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:18.002679    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:05:18.408850 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:18.408669    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:18.471125 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:18.471088    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:18.639170 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:18.639135    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:18.984168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:18.984137    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:19.086437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:19.086393    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:22.911332 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:22.911300    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:35.415864 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.415787    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"]
Sep 20 01:05:35.419284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.419267    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"
Sep 20 01:05:35.423349 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.423323    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:05:35.423813 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.423794    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:05:35.430990 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.430969    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"]
Sep 20 01:05:35.493775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.493754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5832eeab-ff8c-4ccf-810d-e00a2bb0a2af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7db579-xpldt\" (UID: \"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"
Sep 20 01:05:35.594316 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.594295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5832eeab-ff8c-4ccf-810d-e00a2bb0a2af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7db579-xpldt\" (UID: \"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"
Sep 20 01:05:35.594883 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.594864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5832eeab-ff8c-4ccf-810d-e00a2bb0a2af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7db579-xpldt\" (UID: \"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"
Sep 20 01:05:35.722687 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.722616    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:35.729993 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.729975    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"
Sep 20 01:05:35.916780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.916745    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"]
Sep 20 01:05:35.929827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:35.929798    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:36.002107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:36.002079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"]
Sep 20 01:05:36.005443 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:05:36.005419    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5832eeab_ff8c_4ccf_810d_e00a2bb0a2af.slice/crio-a2be235fd22270228106a5d58811efb7eac72ad5f922699203d897ceca63fb41 WatchSource:0}: Error finding container a2be235fd22270228106a5d58811efb7eac72ad5f922699203d897ceca63fb41: Status 404 returned error can't find the container with id a2be235fd22270228106a5d58811efb7eac72ad5f922699203d897ceca63fb41
Sep 20 01:05:36.505324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:36.505302    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt" event={"ID":"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af","Type":"ContainerStarted","Data":"12d7514804df0a4a86585e054ff5b58eec0a239ecb38a510c060d70b62a0ef3e"}
Sep 20 01:05:36.505650 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:36.505338    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt" event={"ID":"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af","Type":"ContainerStarted","Data":"a2be235fd22270228106a5d58811efb7eac72ad5f922699203d897ceca63fb41"}
Sep 20 01:05:36.520936 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:36.520854    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt" podStartSLOduration=1.5208403339999998 podStartE2EDuration="1.520840334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:36.519053938 +0000 UTC m=+1083.512329475" watchObservedRunningTime="2026-09-20 01:05:36.520840334 +0000 UTC m=+1083.514115866"
Sep 20 01:05:36.643040 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:36.643014    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:37.515575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:37.515542    2571 generic.go:356] "Generic (PLEG): container finished" podID="5832eeab-ff8c-4ccf-810d-e00a2bb0a2af" containerID="12d7514804df0a4a86585e054ff5b58eec0a239ecb38a510c060d70b62a0ef3e" exitCode=0
Sep 20 01:05:37.515940 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:37.515862    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt" event={"ID":"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af","Type":"ContainerDied","Data":"12d7514804df0a4a86585e054ff5b58eec0a239ecb38a510c060d70b62a0ef3e"}
Sep 20 01:05:37.539143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:37.539122    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:38.229352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:38.229315    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:38.658695 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:38.658668    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"
Sep 20 01:05:38.720675 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:38.720652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5832eeab-ff8c-4ccf-810d-e00a2bb0a2af-maas-api-service-ca\") pod \"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af\" (UID: \"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af\") "
Sep 20 01:05:38.720964 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:38.720943    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5832eeab-ff8c-4ccf-810d-e00a2bb0a2af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5832eeab-ff8c-4ccf-810d-e00a2bb0a2af" (UID: "5832eeab-ff8c-4ccf-810d-e00a2bb0a2af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:05:38.822265 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:38.822187    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5832eeab-ff8c-4ccf-810d-e00a2bb0a2af-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:05:38.925943 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:38.925915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:39.528524 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:39.528502    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"
Sep 20 01:05:39.528652 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:39.528535    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt" event={"ID":"5832eeab-ff8c-4ccf-810d-e00a2bb0a2af","Type":"ContainerDied","Data":"a2be235fd22270228106a5d58811efb7eac72ad5f922699203d897ceca63fb41"}
Sep 20 01:05:39.528652 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:39.528572    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2be235fd22270228106a5d58811efb7eac72ad5f922699203d897ceca63fb41"
Sep 20 01:05:39.677217 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:39.677166    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:40.419578 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:40.419541    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:41.312061 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:41.312027    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:42.049753 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:42.049715    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:42.819631 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:42.819599    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:43.517334 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:43.517292    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:44.296467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:44.296434    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:44.472732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:44.472692    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:45.084642 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:45.084607    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:45.186136 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:45.186103    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:45.569869 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:45.569833    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:46.236600 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:46.236568    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:46.846551 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:46.846516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:46.919938 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:46.919909    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:46.974134 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:46.974103    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:47.057166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.057107    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"]
Sep 20 01:05:47.059255 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.059226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:47.059661 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.059643    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7db579-xpldt"]
Sep 20 01:05:47.122597 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.122529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:47.408404 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.408326    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:47.508613 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.508581    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:47.510765 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.510738    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5832eeab-ff8c-4ccf-810d-e00a2bb0a2af" path="/var/lib/kubelet/pods/5832eeab-ff8c-4ccf-810d-e00a2bb0a2af/volumes"
Sep 20 01:05:47.898920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:47.898892    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:05:48.162491 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:48.162411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:49.038984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:49.038927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:49.733170 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:49.733132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:50.434867 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:50.434835    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:50.952275 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:50.952240    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4" podUID="6ce9242f-e312-4d67-9664-ebf39429d70d" containerName="main" containerID="cri-o://80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3" gracePeriod=45
Sep 20 01:05:51.206529 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.206471    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:51.246648 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.246618    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:51.331290 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331266    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-home\") pod \"6ce9242f-e312-4d67-9664-ebf39429d70d\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") "
Sep 20 01:05:51.331443 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331307    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce9242f-e312-4d67-9664-ebf39429d70d-tls-certs\") pod \"6ce9242f-e312-4d67-9664-ebf39429d70d\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") "
Sep 20 01:05:51.331443 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331369    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-dshm\") pod \"6ce9242f-e312-4d67-9664-ebf39429d70d\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") "
Sep 20 01:05:51.331443 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331413    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvj5x\" (UniqueName: \"kubernetes.io/projected/6ce9242f-e312-4d67-9664-ebf39429d70d-kube-api-access-wvj5x\") pod \"6ce9242f-e312-4d67-9664-ebf39429d70d\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") "
Sep 20 01:05:51.331608 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331478    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-tmp-dir\") pod \"6ce9242f-e312-4d67-9664-ebf39429d70d\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") "
Sep 20 01:05:51.331608 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331508    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-model-cache\") pod \"6ce9242f-e312-4d67-9664-ebf39429d70d\" (UID: \"6ce9242f-e312-4d67-9664-ebf39429d70d\") "
Sep 20 01:05:51.331608 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331554    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-home" (OuterVolumeSpecName: "home") pod "6ce9242f-e312-4d67-9664-ebf39429d70d" (UID: "6ce9242f-e312-4d67-9664-ebf39429d70d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:51.331822 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331780    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ce9242f-e312-4d67-9664-ebf39429d70d" (UID: "6ce9242f-e312-4d67-9664-ebf39429d70d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:51.331822 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331809    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ce9242f-e312-4d67-9664-ebf39429d70d" (UID: "6ce9242f-e312-4d67-9664-ebf39429d70d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:51.331937 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.331872    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:05:51.333607 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.333577    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce9242f-e312-4d67-9664-ebf39429d70d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ce9242f-e312-4d67-9664-ebf39429d70d" (UID: "6ce9242f-e312-4d67-9664-ebf39429d70d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:05:51.333607 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.333589    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-dshm" (OuterVolumeSpecName: "dshm") pod "6ce9242f-e312-4d67-9664-ebf39429d70d" (UID: "6ce9242f-e312-4d67-9664-ebf39429d70d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:51.333738 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.333637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce9242f-e312-4d67-9664-ebf39429d70d-kube-api-access-wvj5x" (OuterVolumeSpecName: "kube-api-access-wvj5x") pod "6ce9242f-e312-4d67-9664-ebf39429d70d" (UID: "6ce9242f-e312-4d67-9664-ebf39429d70d"). InnerVolumeSpecName "kube-api-access-wvj5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:05:51.432301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.432277    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:05:51.432301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.432299    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:05:51.432301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.432306    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce9242f-e312-4d67-9664-ebf39429d70d-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:05:51.432479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.432314    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce9242f-e312-4d67-9664-ebf39429d70d-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:05:51.432479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.432323    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvj5x\" (UniqueName: \"kubernetes.io/projected/6ce9242f-e312-4d67-9664-ebf39429d70d-kube-api-access-wvj5x\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:05:51.588138 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.588108    2571 generic.go:356] "Generic (PLEG): container finished" podID="6ce9242f-e312-4d67-9664-ebf39429d70d" containerID="80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3" exitCode=0
Sep 20 01:05:51.588448 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.588151    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"
Sep 20 01:05:51.588448 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.588151    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4" event={"ID":"6ce9242f-e312-4d67-9664-ebf39429d70d","Type":"ContainerDied","Data":"80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3"}
Sep 20 01:05:51.588448 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.588241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4" event={"ID":"6ce9242f-e312-4d67-9664-ebf39429d70d","Type":"ContainerDied","Data":"497a82cbad090437d1d3addd2b29fbaf5df39a6cd7bb6f9a3a1731cf7b43c6c8"}
Sep 20 01:05:51.588448 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.588263    2571 scope.go:117] "RemoveContainer" containerID="80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3"
Sep 20 01:05:51.596330 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.596272    2571 scope.go:117] "RemoveContainer" containerID="80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3"
Sep 20 01:05:51.596566 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:05:51.596544    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3\": container with ID starting with 80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3 not found: ID does not exist" containerID="80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3"
Sep 20 01:05:51.596668 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.596574    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3"} err="failed to get container status \"80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3\": rpc error: code = NotFound desc = could not find container \"80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3\": container with ID starting with 80a9fee4bc45b0d216792932034eeb54d2e694b309436412f7682de866638de3 not found: ID does not exist"
Sep 20 01:05:51.606809 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.606785    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"]
Sep 20 01:05:51.608576 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.608556    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-7db579/explicit-model-7db579-kserve-76bb75b549-x96d4"]
Sep 20 01:05:51.924223 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:51.924131    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:52.025355 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.025333    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:52.562751 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.562722    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:52.688628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.688602    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"]
Sep 20 01:05:52.688970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.688955    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5832eeab-ff8c-4ccf-810d-e00a2bb0a2af" containerName="revoke-keys"
Sep 20 01:05:52.688970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.688966    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5832eeab-ff8c-4ccf-810d-e00a2bb0a2af" containerName="revoke-keys"
Sep 20 01:05:52.689039 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.688983    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce9242f-e312-4d67-9664-ebf39429d70d" containerName="main"
Sep 20 01:05:52.689039 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.688990    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce9242f-e312-4d67-9664-ebf39429d70d" containerName="main"
Sep 20 01:05:52.689110 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.689055    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce9242f-e312-4d67-9664-ebf39429d70d" containerName="main"
Sep 20 01:05:52.689110 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.689063    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5832eeab-ff8c-4ccf-810d-e00a2bb0a2af" containerName="revoke-keys"
Sep 20 01:05:52.693815 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.693796    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.696346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.696329    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"e2e-conflict-a-d774ddcf-kserve-self-signed-certs\""
Sep 20 01:05:52.702437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.702415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"]
Sep 20 01:05:52.708634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.708612    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:52.743048 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.743026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-model-cache\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.743142 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.743056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdvk2\" (UniqueName: \"kubernetes.io/projected/81458f7e-5155-41dc-9115-4eb8883b9d04-kube-api-access-xdvk2\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.743142 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.743078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81458f7e-5155-41dc-9115-4eb8883b9d04-tls-certs\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.743142 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.743103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-tmp-dir\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.743291 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.743156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-dshm\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.743291 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.743248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-home\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.843986 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.843913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-model-cache\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.843986 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.843950    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdvk2\" (UniqueName: \"kubernetes.io/projected/81458f7e-5155-41dc-9115-4eb8883b9d04-kube-api-access-xdvk2\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.843986 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.843973    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81458f7e-5155-41dc-9115-4eb8883b9d04-tls-certs\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.844293 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.844009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-tmp-dir\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.844293 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.844036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-dshm\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.844293 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.844095    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-home\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.844467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.844447    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-tmp-dir\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.844511 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.844475    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-model-cache\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.844557 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.844530    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-home\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.846267 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.846245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-dshm\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.846518 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.846503    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81458f7e-5155-41dc-9115-4eb8883b9d04-tls-certs\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:52.851287 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:52.851260    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdvk2\" (UniqueName: \"kubernetes.io/projected/81458f7e-5155-41dc-9115-4eb8883b9d04-kube-api-access-xdvk2\") pod \"e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:53.004868 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.004844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:05:53.280232 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.280205    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"]
Sep 20 01:05:53.282897 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:05:53.282871    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81458f7e_5155_41dc_9115_4eb8883b9d04.slice/crio-7a2f0b5f70ff968417d5a924c4675ff8ab4cf80259725bb0026a4d1343d1b0f4 WatchSource:0}: Error finding container 7a2f0b5f70ff968417d5a924c4675ff8ab4cf80259725bb0026a4d1343d1b0f4: Status 404 returned error can't find the container with id 7a2f0b5f70ff968417d5a924c4675ff8ab4cf80259725bb0026a4d1343d1b0f4
Sep 20 01:05:53.508847 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.508818    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce9242f-e312-4d67-9664-ebf39429d70d" path="/var/lib/kubelet/pods/6ce9242f-e312-4d67-9664-ebf39429d70d/volumes"
Sep 20 01:05:53.550521 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.550458    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:53.599985 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.599957    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv" event={"ID":"81458f7e-5155-41dc-9115-4eb8883b9d04","Type":"ContainerStarted","Data":"d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c"}
Sep 20 01:05:53.600085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.599995    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv" event={"ID":"81458f7e-5155-41dc-9115-4eb8883b9d04","Type":"ContainerStarted","Data":"7a2f0b5f70ff968417d5a924c4675ff8ab4cf80259725bb0026a4d1343d1b0f4"}
Sep 20 01:05:53.616857 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.616813    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv" podStartSLOduration=1.616799401 podStartE2EDuration="1.616799401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:53.616132429 +0000 UTC m=+1100.609407963" watchObservedRunningTime="2026-09-20 01:05:53.616799401 +0000 UTC m=+1100.610074934"
Sep 20 01:05:53.974709 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:53.974631    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:54.071555 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:54.071530    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:54.229795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:54.229711    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:54.378368 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:54.378340    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:54.646683 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:54.646651    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:54.953042 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:54.952835    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:55.103823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:55.103786    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:55.240488 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:55.240378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:56.024506 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:56.024468    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:56.444011 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:56.443926    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:56.546479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:56.546447    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:56.662495 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:56.662471    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:56.816389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:56.816365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:05:57.548874 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:05:57.548836    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:02.795307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:02.795264    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:02.883125 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:02.883090    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:02.948391 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:02.948348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:03.005018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.004972    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:06:03.005169 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.005033    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:06:03.020556 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.020529    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:06:03.021547 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.021520    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:03.095172 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.095082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:03.367260 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.367142    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:03.458588 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.458554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:03.665547 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:03.665470    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:06:04.230780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:04.230745    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:05.050292 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:05.050260    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:05.723575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:05.723541    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:06.540572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:06.540519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:09.017025 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:09.016985    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:09.117563 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:09.117530    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:09.269350 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:09.269276    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:09.587259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:09.587169    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:09.692803 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:09.692770    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:09.814354 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:09.814316    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:15.509706 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:15.509656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:15.574689 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:15.574660    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:15.643604 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:15.643571    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:15.843155 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:15.843080    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:18.695401 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:18.695364    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:06:20.038348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:20.038303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:20.919344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:20.919312    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:21.911036 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:21.911000    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:22.012015 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:22.011986    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:22.349517 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:22.349477    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:22.801438 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:22.801391    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:23.132994 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:23.132920    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:23.734925 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:23.734887    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:25.536886 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:25.536854    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:26.224508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:26.224478    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:26.324480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:26.324448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:27.125216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:27.125165    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:27.927240 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:27.927180    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:28.624593 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:28.624553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:29.330050 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:29.330014    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:29.385677 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:29.385643    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:29.494658 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:29.494622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:29.814173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:29.814143    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:29.900064 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:29.900030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:39.909927 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:39.909887    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:44.398560 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:44.398524    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:06:47.748584 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:47.748538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:47.849354 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:47.849325    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:50.196750 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:50.196715    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:50.313326 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:50.313291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:51.728269 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:51.728238    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:52.397718 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:52.397661    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:53.224362 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:53.224323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:53.900165 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:53.900127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:54.573106 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:54.573074    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:55.437211 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:55.437159    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:56.251445 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:56.251361    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:56.591868 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:56.591766    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:56.905618 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:56.905535    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:57.127274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:57.127235    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:06:59.815739 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:06:59.815709    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:00.542099 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:00.542064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:00.640595 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:00.640559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:01.652667 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:01.652639    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:02.339541 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:02.339511    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:03.122139 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:03.122098    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:03.817344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:03.817302    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:04.535560 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:04.535499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:04.632556 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:04.632528    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:04.946093 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:04.946006    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:05.044732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.044700    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:05.122300 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.122273    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:05.123584 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.123562    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"]
Sep 20 01:07:05.126662 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.126648    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.129006 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.128984    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-b8cbf1\""
Sep 20 01:07:05.129084 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.129052    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-b8cbf1-dockercfg-cwnss\""
Sep 20 01:07:05.136976 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.136955    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"]
Sep 20 01:07:05.261726 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.261692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbqkp\" (UniqueName: \"kubernetes.io/projected/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-kube-api-access-tbqkp\") pod \"payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.261918 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.261880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.362803 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.362771    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbqkp\" (UniqueName: \"kubernetes.io/projected/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-kube-api-access-tbqkp\") pod \"payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.362958 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.362861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.363579 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.363554    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.370712 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.370690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbqkp\" (UniqueName: \"kubernetes.io/projected/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-kube-api-access-tbqkp\") pod \"payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.438642 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.438610    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.707551 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.707437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"]
Sep 20 01:07:05.709962 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:07:05.709928    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa4ed94_6084_42cf_bfbe_ffdc590662a7.slice/crio-283657322dce09a97a42ce7a995fd46f41dafc404d36a89bef90941a5bb37507 WatchSource:0}: Error finding container 283657322dce09a97a42ce7a995fd46f41dafc404d36a89bef90941a5bb37507: Status 404 returned error can't find the container with id 283657322dce09a97a42ce7a995fd46f41dafc404d36a89bef90941a5bb37507
Sep 20 01:07:05.979112 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.979037    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd" event={"ID":"dfa4ed94-6084-42cf-bfbe-ffdc590662a7","Type":"ContainerStarted","Data":"243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717"}
Sep 20 01:07:05.979281 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.979126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd" event={"ID":"dfa4ed94-6084-42cf-bfbe-ffdc590662a7","Type":"ContainerStarted","Data":"283657322dce09a97a42ce7a995fd46f41dafc404d36a89bef90941a5bb37507"}
Sep 20 01:07:05.979281 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.979203    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:05.995988 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:05.995943    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd" podStartSLOduration=0.995931359 podStartE2EDuration="995.931359ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:05.993805588 +0000 UTC m=+1172.987081121" watchObservedRunningTime="2026-09-20 01:07:05.995931359 +0000 UTC m=+1172.989206892"
Sep 20 01:07:07.820446 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:07.820417    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:07.871382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:07.871357    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:16.002056 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:16.002012    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:07:16.987090 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:16.987057    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:07:22.383515 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.383474    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"]
Sep 20 01:07:22.388983 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.388961    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.392895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.392864    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-106d40\"/\"kube-root-ca.crt\""
Sep 20 01:07:22.393166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.393145    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-106d40\"/\"openshift-service-ca.crt\""
Sep 20 01:07:22.393270 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.393217    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-106d40\"/\"noten-model-106d40-kserve-self-signed-certs\""
Sep 20 01:07:22.393381 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.393332    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-106d40\"/\"default-dockercfg-k4smv\""
Sep 20 01:07:22.396297 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.396259    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"]
Sep 20 01:07:22.426655 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.426630    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tmp-dir\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.426753 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.426689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-dshm\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.426753 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.426734    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pg5q\" (UniqueName: \"kubernetes.io/projected/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-kube-api-access-4pg5q\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.426753 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.426751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-home\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.426863 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.426792    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-model-cache\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.426863 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.426812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tls-certs\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.528045 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pg5q\" (UniqueName: \"kubernetes.io/projected/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-kube-api-access-4pg5q\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.528139 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528049    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-home\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.528139 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-model-cache\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.528291 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528153    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tls-certs\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.528535 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-home\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.528535 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528528    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-model-cache\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.528677 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tmp-dir\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.529280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528800    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-dshm\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.529280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.528960    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tmp-dir\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.530844 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.530822    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-dshm\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.531164 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.531146    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tls-certs\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.535998 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.535973    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pg5q\" (UniqueName: \"kubernetes.io/projected/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-kube-api-access-4pg5q\") pod \"noten-model-106d40-kserve-7d648dbc79-df5vg\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") " pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.683722 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.683647    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:22.700516 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.700489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:22.970928 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:22.970902    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"]
Sep 20 01:07:22.973728 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:07:22.973700    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eec497b_3cb2_4a88_9b63_d9c15f36c61f.slice/crio-b1b52cb1a699ffe76f22bce5f6a126938c5b26d7953e5827abb8ba0e6ab3bbf7 WatchSource:0}: Error finding container b1b52cb1a699ffe76f22bce5f6a126938c5b26d7953e5827abb8ba0e6ab3bbf7: Status 404 returned error can't find the container with id b1b52cb1a699ffe76f22bce5f6a126938c5b26d7953e5827abb8ba0e6ab3bbf7
Sep 20 01:07:23.076789 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:23.076739    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg" event={"ID":"9eec497b-3cb2-4a88-9b63-d9c15f36c61f","Type":"ContainerStarted","Data":"40b8cd1e01222908c41efdc58dc4686133c3a82371197fbcc16d693472e753ed"}
Sep 20 01:07:23.076981 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:23.076792    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg" event={"ID":"9eec497b-3cb2-4a88-9b63-d9c15f36c61f","Type":"ContainerStarted","Data":"b1b52cb1a699ffe76f22bce5f6a126938c5b26d7953e5827abb8ba0e6ab3bbf7"}
Sep 20 01:07:23.093045 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:23.092995    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg" podStartSLOduration=1.09298007 podStartE2EDuration="1.09298007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:23.092144537 +0000 UTC m=+1190.085420071" watchObservedRunningTime="2026-09-20 01:07:23.09298007 +0000 UTC m=+1190.086255602"
Sep 20 01:07:26.592558 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:26.592521    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:27.538731 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:27.538697    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:27.913172 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:27.913100    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"]
Sep 20 01:07:27.916677 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:27.916662    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"
Sep 20 01:07:27.919307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:27.919281    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:07:27.919423 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:27.919300    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:07:27.923341 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:27.923320    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"]
Sep 20 01:07:27.977493 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:27.977471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc2030e-bfc1-4868-8954-5ec9af226117-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz\" (UID: \"6cc2030e-bfc1-4868-8954-5ec9af226117\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"
Sep 20 01:07:28.078458 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:28.078424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc2030e-bfc1-4868-8954-5ec9af226117-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz\" (UID: \"6cc2030e-bfc1-4868-8954-5ec9af226117\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"
Sep 20 01:07:28.078994 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:28.078978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc2030e-bfc1-4868-8954-5ec9af226117-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz\" (UID: \"6cc2030e-bfc1-4868-8954-5ec9af226117\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"
Sep 20 01:07:28.228506 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:28.228445    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"
Sep 20 01:07:28.429734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:28.429701    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:28.499790 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:28.499762    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"]
Sep 20 01:07:28.502642 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:07:28.502613    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc2030e_bfc1_4868_8954_5ec9af226117.slice/crio-9b4ed1a230da52bd17cfe69915eef3272affc24d4689d73ba9c1cb2d10c5e686 WatchSource:0}: Error finding container 9b4ed1a230da52bd17cfe69915eef3272affc24d4689d73ba9c1cb2d10c5e686: Status 404 returned error can't find the container with id 9b4ed1a230da52bd17cfe69915eef3272affc24d4689d73ba9c1cb2d10c5e686
Sep 20 01:07:29.110074 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:29.110044    2571 generic.go:356] "Generic (PLEG): container finished" podID="6cc2030e-bfc1-4868-8954-5ec9af226117" containerID="6b103a2c7c1b3662aa63f94452f99ea7b1d46ef65490018338153b225ac539e0" exitCode=0
Sep 20 01:07:29.110380 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:29.110111    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz" event={"ID":"6cc2030e-bfc1-4868-8954-5ec9af226117","Type":"ContainerDied","Data":"6b103a2c7c1b3662aa63f94452f99ea7b1d46ef65490018338153b225ac539e0"}
Sep 20 01:07:29.110380 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:29.110153    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz" event={"ID":"6cc2030e-bfc1-4868-8954-5ec9af226117","Type":"ContainerStarted","Data":"9b4ed1a230da52bd17cfe69915eef3272affc24d4689d73ba9c1cb2d10c5e686"}
Sep 20 01:07:29.216140 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:29.216112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:30.015547 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:30.015507    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:30.256123 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:30.256100    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"
Sep 20 01:07:30.300358 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:30.300305    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc2030e-bfc1-4868-8954-5ec9af226117-maas-api-service-ca\") pod \"6cc2030e-bfc1-4868-8954-5ec9af226117\" (UID: \"6cc2030e-bfc1-4868-8954-5ec9af226117\") "
Sep 20 01:07:30.300623 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:30.300601    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cc2030e-bfc1-4868-8954-5ec9af226117-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6cc2030e-bfc1-4868-8954-5ec9af226117" (UID: "6cc2030e-bfc1-4868-8954-5ec9af226117"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:07:30.300704 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:30.300692    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc2030e-bfc1-4868-8954-5ec9af226117-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:30.495184 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:30.495163    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:30.697517 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:30.697437    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:31.122982 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:31.122954    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"
Sep 20 01:07:31.123182 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:31.123008    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz" event={"ID":"6cc2030e-bfc1-4868-8954-5ec9af226117","Type":"ContainerDied","Data":"9b4ed1a230da52bd17cfe69915eef3272affc24d4689d73ba9c1cb2d10c5e686"}
Sep 20 01:07:31.123182 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:31.123061    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b4ed1a230da52bd17cfe69915eef3272affc24d4689d73ba9c1cb2d10c5e686"
Sep 20 01:07:31.544661 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:31.544629    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:32.302427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:32.302390    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:32.701529 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:32.701447    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:32.701916 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:32.701740    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:32.714393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:32.714368    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:32.980957 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:32.980881    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:33.145923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:33.145891    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:07:33.564915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:33.564882    2571 scope.go:117] "RemoveContainer" containerID="2324bd1fb652d0e0e4ebd4ecac7f69c34050f2c7265d18b547d27c0e33efcdc1"
Sep 20 01:07:35.906041 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:35.906007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:38.044792 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.044754    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:38.682439 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.682405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:38.688654 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.688623    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"]
Sep 20 01:07:38.731766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.731737    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"]
Sep 20 01:07:38.732022 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.731976    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj" podUID="188c387e-0a14-4d36-b958-aec8516bcc46" containerName="payload-pre-processing" containerID="cri-o://9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02" gracePeriod=30
Sep 20 01:07:38.750669 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.750626    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:38.806888 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.806861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:38.895965 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.895931    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"]
Sep 20 01:07:38.898014 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.897985    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2fd525-hpnsz"]
Sep 20 01:07:38.898414 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.898385    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:38.958105 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.958041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:38.988356 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:38.988337    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:07:39.080500 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.080474    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qcfp\" (UniqueName: \"kubernetes.io/projected/188c387e-0a14-4d36-b958-aec8516bcc46-kube-api-access-8qcfp\") pod \"188c387e-0a14-4d36-b958-aec8516bcc46\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") "
Sep 20 01:07:39.080947 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.080633    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/188c387e-0a14-4d36-b958-aec8516bcc46-plugins-config-volume\") pod \"188c387e-0a14-4d36-b958-aec8516bcc46\" (UID: \"188c387e-0a14-4d36-b958-aec8516bcc46\") "
Sep 20 01:07:39.081059 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.081017    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/188c387e-0a14-4d36-b958-aec8516bcc46-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "188c387e-0a14-4d36-b958-aec8516bcc46" (UID: "188c387e-0a14-4d36-b958-aec8516bcc46"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:07:39.081209 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.081175    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/188c387e-0a14-4d36-b958-aec8516bcc46-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.083060 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.083024    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/188c387e-0a14-4d36-b958-aec8516bcc46-kube-api-access-8qcfp" (OuterVolumeSpecName: "kube-api-access-8qcfp") pod "188c387e-0a14-4d36-b958-aec8516bcc46" (UID: "188c387e-0a14-4d36-b958-aec8516bcc46"). InnerVolumeSpecName "kube-api-access-8qcfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:39.167334 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.167307    2571 generic.go:356] "Generic (PLEG): container finished" podID="188c387e-0a14-4d36-b958-aec8516bcc46" containerID="9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02" exitCode=0
Sep 20 01:07:39.167435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.167350    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"
Sep 20 01:07:39.167435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.167390    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj" event={"ID":"188c387e-0a14-4d36-b958-aec8516bcc46","Type":"ContainerDied","Data":"9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02"}
Sep 20 01:07:39.167514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.167448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj" event={"ID":"188c387e-0a14-4d36-b958-aec8516bcc46","Type":"ContainerDied","Data":"5d808d0002a9dff4a6f3d48726aff0412baf4661a440a2c38c99067f78f05ca8"}
Sep 20 01:07:39.167514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.167477    2571 scope.go:117] "RemoveContainer" containerID="9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02"
Sep 20 01:07:39.175835 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.175818    2571 scope.go:117] "RemoveContainer" containerID="9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02"
Sep 20 01:07:39.176131 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:07:39.176112    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02\": container with ID starting with 9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02 not found: ID does not exist" containerID="9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02"
Sep 20 01:07:39.176212 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.176141    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02"} err="failed to get container status \"9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02\": rpc error: code = NotFound desc = could not find container \"9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02\": container with ID starting with 9aca0a0bf6e9d3ca7279892d2d72f301926cd885a16aca97847a1e4840f61e02 not found: ID does not exist"
Sep 20 01:07:39.181837 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.181817    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qcfp\" (UniqueName: \"kubernetes.io/projected/188c387e-0a14-4d36-b958-aec8516bcc46-kube-api-access-8qcfp\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.188381 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.188359    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"]
Sep 20 01:07:39.194005 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.193984    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj"]
Sep 20 01:07:39.220935 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.220882    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:39.325385 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.325361    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:39.509795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.509767    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="188c387e-0a14-4d36-b958-aec8516bcc46" path="/var/lib/kubelet/pods/188c387e-0a14-4d36-b958-aec8516bcc46/volumes"
Sep 20 01:07:39.510141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.510127    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc2030e-bfc1-4868-8954-5ec9af226117" path="/var/lib/kubelet/pods/6cc2030e-bfc1-4868-8954-5ec9af226117/volumes"
Sep 20 01:07:39.947226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:39.947126    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:40.047351 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:40.047323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:40.269086 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:40.269054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:40.576941 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:40.576859    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:40.934898 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:40.934807    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:41.725253 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:41.725222    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:42.485740 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:42.485705    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:43.268203 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:43.268150    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:43.769271 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:43.769238    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:43.872112 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:43.872081    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:44.125065 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:44.124970    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:44.325504 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:44.325474    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:44.827714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:44.827681    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:45.620042 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:45.620009    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:46.301787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:46.301742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:47.049692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:47.049658    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:47.720971 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:47.720935    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:47.778281 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:47.778260    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:47.878031 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:47.878008    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:48.195995 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.195968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:48.290913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.290876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:48.332959 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.332930    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"]
Sep 20 01:07:48.333341 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.333328    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="188c387e-0a14-4d36-b958-aec8516bcc46" containerName="payload-pre-processing"
Sep 20 01:07:48.333393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.333342    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="188c387e-0a14-4d36-b958-aec8516bcc46" containerName="payload-pre-processing"
Sep 20 01:07:48.333393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.333363    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc2030e-bfc1-4868-8954-5ec9af226117" containerName="revoke-keys"
Sep 20 01:07:48.333393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.333368    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc2030e-bfc1-4868-8954-5ec9af226117" containerName="revoke-keys"
Sep 20 01:07:48.333494 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.333425    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc2030e-bfc1-4868-8954-5ec9af226117" containerName="revoke-keys"
Sep 20 01:07:48.333494 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.333435    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="188c387e-0a14-4d36-b958-aec8516bcc46" containerName="payload-pre-processing"
Sep 20 01:07:48.337518 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.337504    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.339835 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.339816    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8b864c4f\""
Sep 20 01:07:48.339928 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.339911    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8b864c4f-dockercfg-smxvc\""
Sep 20 01:07:48.350946 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.350922    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"]
Sep 20 01:07:48.465671 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.465505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qhz\" (UniqueName: \"kubernetes.io/projected/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-kube-api-access-m9qhz\") pod \"payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") " pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.465671 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.465574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-plugins-config-volume\") pod \"payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") " pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.566343 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.566308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qhz\" (UniqueName: \"kubernetes.io/projected/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-kube-api-access-m9qhz\") pod \"payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") " pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.566467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.566376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-plugins-config-volume\") pod \"payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") " pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.567055 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.567035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-plugins-config-volume\") pod \"payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") " pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.573801 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.573774    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qhz\" (UniqueName: \"kubernetes.io/projected/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-kube-api-access-m9qhz\") pod \"payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") " pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.647710 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.647682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:48.920690 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:48.920661    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"]
Sep 20 01:07:48.922838 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:07:48.922811    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc488eb7_02ec_46eb_9a65_c12f4a9aad74.slice/crio-f16bafd3fc5969c129905fd8b64c91d887d8eb5f22ae0375f58110517ac3ef4c WatchSource:0}: Error finding container f16bafd3fc5969c129905fd8b64c91d887d8eb5f22ae0375f58110517ac3ef4c: Status 404 returned error can't find the container with id f16bafd3fc5969c129905fd8b64c91d887d8eb5f22ae0375f58110517ac3ef4c
Sep 20 01:07:49.229802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:49.229712    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f" event={"ID":"bc488eb7-02ec-46eb-9a65-c12f4a9aad74","Type":"ContainerStarted","Data":"5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef"}
Sep 20 01:07:49.229802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:49.229772    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f" event={"ID":"bc488eb7-02ec-46eb-9a65-c12f4a9aad74","Type":"ContainerStarted","Data":"f16bafd3fc5969c129905fd8b64c91d887d8eb5f22ae0375f58110517ac3ef4c"}
Sep 20 01:07:49.229802 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:49.229802    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:07:49.249267 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:49.249188    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f" podStartSLOduration=1.249168471 podStartE2EDuration="1.249168471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:49.246439592 +0000 UTC m=+1216.239715128" watchObservedRunningTime="2026-09-20 01:07:49.249168471 +0000 UTC m=+1216.242444008"
Sep 20 01:07:51.302087 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:51.302048    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:07:53.708316 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:53.708278    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z" podUID="dd41336f-cd40-416d-a8d7-cca7849d9430" containerName="main" containerID="cri-o://60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491" gracePeriod=45
Sep 20 01:07:53.961854 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:53.961790    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:07:54.115252 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115221    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtnqq\" (UniqueName: \"kubernetes.io/projected/dd41336f-cd40-416d-a8d7-cca7849d9430-kube-api-access-rtnqq\") pod \"dd41336f-cd40-416d-a8d7-cca7849d9430\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") "
Sep 20 01:07:54.115402 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115262    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-model-cache\") pod \"dd41336f-cd40-416d-a8d7-cca7849d9430\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") "
Sep 20 01:07:54.115402 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115342    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-home\") pod \"dd41336f-cd40-416d-a8d7-cca7849d9430\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") "
Sep 20 01:07:54.115402 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115374    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd41336f-cd40-416d-a8d7-cca7849d9430-tls-certs\") pod \"dd41336f-cd40-416d-a8d7-cca7849d9430\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") "
Sep 20 01:07:54.115575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115441    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-dshm\") pod \"dd41336f-cd40-416d-a8d7-cca7849d9430\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") "
Sep 20 01:07:54.115575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115498    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-tmp-dir\") pod \"dd41336f-cd40-416d-a8d7-cca7849d9430\" (UID: \"dd41336f-cd40-416d-a8d7-cca7849d9430\") "
Sep 20 01:07:54.115575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115507    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd41336f-cd40-416d-a8d7-cca7849d9430" (UID: "dd41336f-cd40-416d-a8d7-cca7849d9430"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:07:54.115719 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115596    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-home" (OuterVolumeSpecName: "home") pod "dd41336f-cd40-416d-a8d7-cca7849d9430" (UID: "dd41336f-cd40-416d-a8d7-cca7849d9430"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:07:54.115815 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115796    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:54.115878 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115824    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:54.115878 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.115792    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd41336f-cd40-416d-a8d7-cca7849d9430" (UID: "dd41336f-cd40-416d-a8d7-cca7849d9430"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:07:54.117468 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.117442    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd41336f-cd40-416d-a8d7-cca7849d9430-kube-api-access-rtnqq" (OuterVolumeSpecName: "kube-api-access-rtnqq") pod "dd41336f-cd40-416d-a8d7-cca7849d9430" (UID: "dd41336f-cd40-416d-a8d7-cca7849d9430"). InnerVolumeSpecName "kube-api-access-rtnqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:54.117574 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.117501    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-dshm" (OuterVolumeSpecName: "dshm") pod "dd41336f-cd40-416d-a8d7-cca7849d9430" (UID: "dd41336f-cd40-416d-a8d7-cca7849d9430"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:07:54.117574 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.117547    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd41336f-cd40-416d-a8d7-cca7849d9430-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd41336f-cd40-416d-a8d7-cca7849d9430" (UID: "dd41336f-cd40-416d-a8d7-cca7849d9430"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:07:54.216843 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.216792    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:54.216843 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.216812    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtnqq\" (UniqueName: \"kubernetes.io/projected/dd41336f-cd40-416d-a8d7-cca7849d9430-kube-api-access-rtnqq\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:54.216843 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.216821    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd41336f-cd40-416d-a8d7-cca7849d9430-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:54.216843 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.216829    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd41336f-cd40-416d-a8d7-cca7849d9430-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:07:54.258216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.258164    2571 generic.go:356] "Generic (PLEG): container finished" podID="dd41336f-cd40-416d-a8d7-cca7849d9430" containerID="60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491" exitCode=0
Sep 20 01:07:54.258324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.258227    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"
Sep 20 01:07:54.258324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.258240    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z" event={"ID":"dd41336f-cd40-416d-a8d7-cca7849d9430","Type":"ContainerDied","Data":"60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491"}
Sep 20 01:07:54.258324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.258280    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z" event={"ID":"dd41336f-cd40-416d-a8d7-cca7849d9430","Type":"ContainerDied","Data":"a794e97d8a1514be827c3228a1b39b0cbf8af14882145cd48688bb258b30355e"}
Sep 20 01:07:54.258324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.258298    2571 scope.go:117] "RemoveContainer" containerID="60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491"
Sep 20 01:07:54.267049 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.267033    2571 scope.go:117] "RemoveContainer" containerID="60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491"
Sep 20 01:07:54.267327 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:07:54.267306    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491\": container with ID starting with 60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491 not found: ID does not exist" containerID="60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491"
Sep 20 01:07:54.267397 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.267338    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491"} err="failed to get container status \"60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491\": rpc error: code = NotFound desc = could not find container \"60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491\": container with ID starting with 60c7aa4b16056f8404d195acba7c59acc152aa5eb9f6f23d39435b7f5329c491 not found: ID does not exist"
Sep 20 01:07:54.278787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.278763    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"]
Sep 20 01:07:54.280639 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.280615    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2fd525/test-model-2fd525-kserve-dcbdd6f65-zmt5z"]
Sep 20 01:07:54.881751 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:54.881723    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:55.097256 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:55.097223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:55.201888 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:55.201814    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:07:55.509987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:07:55.509942    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd41336f-cd40-416d-a8d7-cca7849d9430" path="/var/lib/kubelet/pods/dd41336f-cd40-416d-a8d7-cca7849d9430/volumes"
Sep 20 01:08:00.184225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:00.184177    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"]
Sep 20 01:08:00.237956 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:00.237931    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:08:00.264589 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:00.264562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:10.716945 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:10.716901    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:11.543798 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:11.543762    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:12.249114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:12.249083    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:12.927878 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:12.927847    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:13.740242 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:13.740202    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:13.838763 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:13.838735    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:14.462499 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:14.462467    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:15.203137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.203103    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg" podUID="9eec497b-3cb2-4a88-9b63-d9c15f36c61f" containerName="main" containerID="cri-o://40b8cd1e01222908c41efdc58dc4686133c3a82371197fbcc16d693472e753ed" gracePeriod=45
Sep 20 01:08:15.308705 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.308676    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"]
Sep 20 01:08:15.332088 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.332040    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:15.376826 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.376794    2571 generic.go:356] "Generic (PLEG): container finished" podID="9eec497b-3cb2-4a88-9b63-d9c15f36c61f" containerID="40b8cd1e01222908c41efdc58dc4686133c3a82371197fbcc16d693472e753ed" exitCode=0
Sep 20 01:08:15.376954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.376883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg" event={"ID":"9eec497b-3cb2-4a88-9b63-d9c15f36c61f","Type":"ContainerDied","Data":"40b8cd1e01222908c41efdc58dc4686133c3a82371197fbcc16d693472e753ed"}
Sep 20 01:08:15.428714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.428679    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:15.462026 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.461975    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:08:15.494458 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494428    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tls-certs\") pod \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") "
Sep 20 01:08:15.494596 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494473    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pg5q\" (UniqueName: \"kubernetes.io/projected/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-kube-api-access-4pg5q\") pod \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") "
Sep 20 01:08:15.494596 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494529    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-home\") pod \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") "
Sep 20 01:08:15.494596 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-model-cache\") pod \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") "
Sep 20 01:08:15.494775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494624    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tmp-dir\") pod \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") "
Sep 20 01:08:15.494775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494669    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-dshm\") pod \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\" (UID: \"9eec497b-3cb2-4a88-9b63-d9c15f36c61f\") "
Sep 20 01:08:15.495212 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494898    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-model-cache" (OuterVolumeSpecName: "model-cache") pod "9eec497b-3cb2-4a88-9b63-d9c15f36c61f" (UID: "9eec497b-3cb2-4a88-9b63-d9c15f36c61f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:15.495212 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494911    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-home" (OuterVolumeSpecName: "home") pod "9eec497b-3cb2-4a88-9b63-d9c15f36c61f" (UID: "9eec497b-3cb2-4a88-9b63-d9c15f36c61f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:15.495212 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.494966    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9eec497b-3cb2-4a88-9b63-d9c15f36c61f" (UID: "9eec497b-3cb2-4a88-9b63-d9c15f36c61f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:15.495212 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.495119    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:15.495212 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.495136    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:15.495212 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.495149    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:15.496879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.496855    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9eec497b-3cb2-4a88-9b63-d9c15f36c61f" (UID: "9eec497b-3cb2-4a88-9b63-d9c15f36c61f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:08:15.497008 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.496989    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-dshm" (OuterVolumeSpecName: "dshm") pod "9eec497b-3cb2-4a88-9b63-d9c15f36c61f" (UID: "9eec497b-3cb2-4a88-9b63-d9c15f36c61f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:15.497227 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.497168    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-kube-api-access-4pg5q" (OuterVolumeSpecName: "kube-api-access-4pg5q") pod "9eec497b-3cb2-4a88-9b63-d9c15f36c61f" (UID: "9eec497b-3cb2-4a88-9b63-d9c15f36c61f"). InnerVolumeSpecName "kube-api-access-4pg5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:15.595627 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.595600    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:15.595627 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.595623    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:15.595773 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:15.595637    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pg5q\" (UniqueName: \"kubernetes.io/projected/9eec497b-3cb2-4a88-9b63-d9c15f36c61f-kube-api-access-4pg5q\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:16.383597 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:16.383556    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg" event={"ID":"9eec497b-3cb2-4a88-9b63-d9c15f36c61f","Type":"ContainerDied","Data":"b1b52cb1a699ffe76f22bce5f6a126938c5b26d7953e5827abb8ba0e6ab3bbf7"}
Sep 20 01:08:16.383597 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:16.383603    2571 scope.go:117] "RemoveContainer" containerID="40b8cd1e01222908c41efdc58dc4686133c3a82371197fbcc16d693472e753ed"
Sep 20 01:08:16.384123 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:16.383601    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"
Sep 20 01:08:16.400712 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:16.400689    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"]
Sep 20 01:08:16.404162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:16.404136    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-106d40/noten-model-106d40-kserve-7d648dbc79-df5vg"]
Sep 20 01:08:16.992719 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:16.992694    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:17.509753 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:17.509713    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eec497b-3cb2-4a88-9b63-d9c15f36c61f" path="/var/lib/kubelet/pods/9eec497b-3cb2-4a88-9b63-d9c15f36c61f/volumes"
Sep 20 01:08:19.412615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:19.412582    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:08:21.315164 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.315127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:21.546930 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.546894    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:21.871509 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.871482    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"]
Sep 20 01:08:21.871849 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.871838    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd41336f-cd40-416d-a8d7-cca7849d9430" containerName="main"
Sep 20 01:08:21.871895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.871851    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd41336f-cd40-416d-a8d7-cca7849d9430" containerName="main"
Sep 20 01:08:21.871895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.871864    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eec497b-3cb2-4a88-9b63-d9c15f36c61f" containerName="main"
Sep 20 01:08:21.871895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.871869    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eec497b-3cb2-4a88-9b63-d9c15f36c61f" containerName="main"
Sep 20 01:08:21.871989 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.871942    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd41336f-cd40-416d-a8d7-cca7849d9430" containerName="main"
Sep 20 01:08:21.871989 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.871951    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eec497b-3cb2-4a88-9b63-d9c15f36c61f" containerName="main"
Sep 20 01:08:21.876281 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.876264    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"
Sep 20 01:08:21.879026 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.879001    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:08:21.880184 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.880160    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:08:21.881546 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.881525    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"]
Sep 20 01:08:21.948276 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:21.948247    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d06b6-4975-45bd-9450-03ff100a9ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc\" (UID: \"141d06b6-4975-45bd-9450-03ff100a9ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"
Sep 20 01:08:22.035749 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:22.035726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:22.048774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:22.048751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d06b6-4975-45bd-9450-03ff100a9ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc\" (UID: \"141d06b6-4975-45bd-9450-03ff100a9ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"
Sep 20 01:08:22.049358 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:22.049340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d06b6-4975-45bd-9450-03ff100a9ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc\" (UID: \"141d06b6-4975-45bd-9450-03ff100a9ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"
Sep 20 01:08:22.188241 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:22.188155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"
Sep 20 01:08:22.456335 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:22.456266    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"]
Sep 20 01:08:22.459597 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:08:22.459568    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141d06b6_4975_45bd_9450_03ff100a9ebf.slice/crio-664e9b7981493d16e70b13e34660633dbc23f1cd0c32541495ad2de070fd2ec5 WatchSource:0}: Error finding container 664e9b7981493d16e70b13e34660633dbc23f1cd0c32541495ad2de070fd2ec5: Status 404 returned error can't find the container with id 664e9b7981493d16e70b13e34660633dbc23f1cd0c32541495ad2de070fd2ec5
Sep 20 01:08:22.922265 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:22.922239    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:23.078870 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:08:23.078840    2571 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141d06b6_4975_45bd_9450_03ff100a9ebf.slice/crio-850a321bffde53573d90b8b55d226988b11ecb0fe16efdc97fbae033f32058b3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141d06b6_4975_45bd_9450_03ff100a9ebf.slice/crio-conmon-850a321bffde53573d90b8b55d226988b11ecb0fe16efdc97fbae033f32058b3.scope\": RecentStats: unable to find data in memory cache]"
Sep 20 01:08:23.421605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:23.421540    2571 generic.go:356] "Generic (PLEG): container finished" podID="141d06b6-4975-45bd-9450-03ff100a9ebf" containerID="850a321bffde53573d90b8b55d226988b11ecb0fe16efdc97fbae033f32058b3" exitCode=0
Sep 20 01:08:23.421714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:23.421630    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc" event={"ID":"141d06b6-4975-45bd-9450-03ff100a9ebf","Type":"ContainerDied","Data":"850a321bffde53573d90b8b55d226988b11ecb0fe16efdc97fbae033f32058b3"}
Sep 20 01:08:23.421714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:23.421682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc" event={"ID":"141d06b6-4975-45bd-9450-03ff100a9ebf","Type":"ContainerStarted","Data":"664e9b7981493d16e70b13e34660633dbc23f1cd0c32541495ad2de070fd2ec5"}
Sep 20 01:08:23.731093 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:23.731031    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:24.384863 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:24.384832    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:24.561646 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:24.561622    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"
Sep 20 01:08:24.671500 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:24.671426    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d06b6-4975-45bd-9450-03ff100a9ebf-maas-api-service-ca\") pod \"141d06b6-4975-45bd-9450-03ff100a9ebf\" (UID: \"141d06b6-4975-45bd-9450-03ff100a9ebf\") "
Sep 20 01:08:24.671754 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:24.671731    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/141d06b6-4975-45bd-9450-03ff100a9ebf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "141d06b6-4975-45bd-9450-03ff100a9ebf" (UID: "141d06b6-4975-45bd-9450-03ff100a9ebf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:08:24.772406 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:24.772379    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d06b6-4975-45bd-9450-03ff100a9ebf-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:25.141648 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:25.141615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:25.433228 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:25.433114    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc" event={"ID":"141d06b6-4975-45bd-9450-03ff100a9ebf","Type":"ContainerDied","Data":"664e9b7981493d16e70b13e34660633dbc23f1cd0c32541495ad2de070fd2ec5"}
Sep 20 01:08:25.433228 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:25.433146    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"
Sep 20 01:08:25.433414 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:25.433230    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="664e9b7981493d16e70b13e34660633dbc23f1cd0c32541495ad2de070fd2ec5"
Sep 20 01:08:26.003756 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:26.003664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:26.664810 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:26.664782    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:27.338622 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:27.338592    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:28.878208 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:28.878122    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:28.978801 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:28.978769    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:30.329522 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.329471    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh" podUID="4e23e195-c32c-4f44-b14b-0763b8243ae2" containerName="main" containerID="cri-o://e0173a7958e298a66e42e9073930375889967c6801de4a9016d38de53d51295a" gracePeriod=45
Sep 20 01:08:30.462043 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.462010    2571 generic.go:356] "Generic (PLEG): container finished" podID="4e23e195-c32c-4f44-b14b-0763b8243ae2" containerID="e0173a7958e298a66e42e9073930375889967c6801de4a9016d38de53d51295a" exitCode=0
Sep 20 01:08:30.462184 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.462103    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh" event={"ID":"4e23e195-c32c-4f44-b14b-0763b8243ae2","Type":"ContainerDied","Data":"e0173a7958e298a66e42e9073930375889967c6801de4a9016d38de53d51295a"}
Sep 20 01:08:30.580876 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.580822    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:08:30.724754 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.724726    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-model-cache\") pod \"4e23e195-c32c-4f44-b14b-0763b8243ae2\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") "
Sep 20 01:08:30.724915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.724767    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e23e195-c32c-4f44-b14b-0763b8243ae2-tls-certs\") pod \"4e23e195-c32c-4f44-b14b-0763b8243ae2\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") "
Sep 20 01:08:30.724915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.724789    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-home\") pod \"4e23e195-c32c-4f44-b14b-0763b8243ae2\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") "
Sep 20 01:08:30.724915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.724834    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvtrt\" (UniqueName: \"kubernetes.io/projected/4e23e195-c32c-4f44-b14b-0763b8243ae2-kube-api-access-lvtrt\") pod \"4e23e195-c32c-4f44-b14b-0763b8243ae2\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") "
Sep 20 01:08:30.724915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.724879    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-tmp-dir\") pod \"4e23e195-c32c-4f44-b14b-0763b8243ae2\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") "
Sep 20 01:08:30.724915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.724907    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-dshm\") pod \"4e23e195-c32c-4f44-b14b-0763b8243ae2\" (UID: \"4e23e195-c32c-4f44-b14b-0763b8243ae2\") "
Sep 20 01:08:30.725180 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.724974    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-model-cache" (OuterVolumeSpecName: "model-cache") pod "4e23e195-c32c-4f44-b14b-0763b8243ae2" (UID: "4e23e195-c32c-4f44-b14b-0763b8243ae2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:30.725180 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.725129    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-home" (OuterVolumeSpecName: "home") pod "4e23e195-c32c-4f44-b14b-0763b8243ae2" (UID: "4e23e195-c32c-4f44-b14b-0763b8243ae2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:30.725180 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.725155    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4e23e195-c32c-4f44-b14b-0763b8243ae2" (UID: "4e23e195-c32c-4f44-b14b-0763b8243ae2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:30.725344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.725242    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:30.727020 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.726988    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e23e195-c32c-4f44-b14b-0763b8243ae2-kube-api-access-lvtrt" (OuterVolumeSpecName: "kube-api-access-lvtrt") pod "4e23e195-c32c-4f44-b14b-0763b8243ae2" (UID: "4e23e195-c32c-4f44-b14b-0763b8243ae2"). InnerVolumeSpecName "kube-api-access-lvtrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:30.727127 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.727011    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-dshm" (OuterVolumeSpecName: "dshm") pod "4e23e195-c32c-4f44-b14b-0763b8243ae2" (UID: "4e23e195-c32c-4f44-b14b-0763b8243ae2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:30.727127 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.727016    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e23e195-c32c-4f44-b14b-0763b8243ae2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4e23e195-c32c-4f44-b14b-0763b8243ae2" (UID: "4e23e195-c32c-4f44-b14b-0763b8243ae2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:08:30.826268 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.826244    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:30.826268 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.826265    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e23e195-c32c-4f44-b14b-0763b8243ae2-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:30.826406 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.826275    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:30.826406 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.826284    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvtrt\" (UniqueName: \"kubernetes.io/projected/4e23e195-c32c-4f44-b14b-0763b8243ae2-kube-api-access-lvtrt\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:30.826406 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:30.826293    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e23e195-c32c-4f44-b14b-0763b8243ae2-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:31.468624 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:31.468585    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh" event={"ID":"4e23e195-c32c-4f44-b14b-0763b8243ae2","Type":"ContainerDied","Data":"71f3a6103500505c3e87915abf5f634a7366c465c39e4c95610b89656b38b0bc"}
Sep 20 01:08:31.468999 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:31.468634    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"
Sep 20 01:08:31.468999 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:31.468642    2571 scope.go:117] "RemoveContainer" containerID="e0173a7958e298a66e42e9073930375889967c6801de4a9016d38de53d51295a"
Sep 20 01:08:31.491008 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:31.490983    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"]
Sep 20 01:08:31.496736 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:31.496711    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-376bcf/test-model-376bcf-kserve-55ccb9c7dc-jwslh"]
Sep 20 01:08:31.508660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:31.508635    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e23e195-c32c-4f44-b14b-0763b8243ae2" path="/var/lib/kubelet/pods/4e23e195-c32c-4f44-b14b-0763b8243ae2/volumes"
Sep 20 01:08:32.530820 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.530789    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:32.542348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.542313    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"]
Sep 20 01:08:32.542574 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.542551    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn" podUID="3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" containerName="payload-processing" containerID="cri-o://70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b" gracePeriod=30
Sep 20 01:08:32.551468 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.551441    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"]
Sep 20 01:08:32.551822 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.551795    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr" podUID="407bb8cb-3056-420b-a254-3053766f3597" containerName="payload-pre-processing" containerID="cri-o://597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976" gracePeriod=30
Sep 20 01:08:32.628740 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.628701    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:32.714543 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.714472    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"]
Sep 20 01:08:32.717395 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.717347    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:32.717541 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.717414    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376bcf-5bcvc"]
Sep 20 01:08:32.785547 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.785476    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:32.821313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.821293    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:08:32.824214 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.824172    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:08:32.945023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.944989    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgm9w\" (UniqueName: \"kubernetes.io/projected/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-kube-api-access-kgm9w\") pod \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") "
Sep 20 01:08:32.945023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.945023    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/407bb8cb-3056-420b-a254-3053766f3597-plugins-config-volume\") pod \"407bb8cb-3056-420b-a254-3053766f3597\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") "
Sep 20 01:08:32.945314 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.945053    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-plugins-config-volume\") pod \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\" (UID: \"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f\") "
Sep 20 01:08:32.945314 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.945158    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66xkm\" (UniqueName: \"kubernetes.io/projected/407bb8cb-3056-420b-a254-3053766f3597-kube-api-access-66xkm\") pod \"407bb8cb-3056-420b-a254-3053766f3597\" (UID: \"407bb8cb-3056-420b-a254-3053766f3597\") "
Sep 20 01:08:32.945444 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.945418    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/407bb8cb-3056-420b-a254-3053766f3597-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "407bb8cb-3056-420b-a254-3053766f3597" (UID: "407bb8cb-3056-420b-a254-3053766f3597"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:08:32.945500 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.945454    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" (UID: "3f7a3182-e13f-4fdf-a8b6-98e5b77af27f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:08:32.945563 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.945539    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/407bb8cb-3056-420b-a254-3053766f3597-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:32.945563 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.945557    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:32.947233 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.947206    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/407bb8cb-3056-420b-a254-3053766f3597-kube-api-access-66xkm" (OuterVolumeSpecName: "kube-api-access-66xkm") pod "407bb8cb-3056-420b-a254-3053766f3597" (UID: "407bb8cb-3056-420b-a254-3053766f3597"). InnerVolumeSpecName "kube-api-access-66xkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:32.947335 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:32.947253    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-kube-api-access-kgm9w" (OuterVolumeSpecName: "kube-api-access-kgm9w") pod "3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" (UID: "3f7a3182-e13f-4fdf-a8b6-98e5b77af27f"). InnerVolumeSpecName "kube-api-access-kgm9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:33.046621 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.046566    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgm9w\" (UniqueName: \"kubernetes.io/projected/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f-kube-api-access-kgm9w\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:33.046621 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.046589    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66xkm\" (UniqueName: \"kubernetes.io/projected/407bb8cb-3056-420b-a254-3053766f3597-kube-api-access-66xkm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:33.080966 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.080933    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:33.144466 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.144431    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:33.480107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.480025    2571 generic.go:356] "Generic (PLEG): container finished" podID="3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" containerID="70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b" exitCode=0
Sep 20 01:08:33.480107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.480075    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"
Sep 20 01:08:33.480309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.480117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn" event={"ID":"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f","Type":"ContainerDied","Data":"70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b"}
Sep 20 01:08:33.480309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.480162    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn" event={"ID":"3f7a3182-e13f-4fdf-a8b6-98e5b77af27f","Type":"ContainerDied","Data":"3a3b5acac2a97edf087fd4dbcf1d3ba070bfabe2442be23ee901e363de9f1e8c"}
Sep 20 01:08:33.480309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.480185    2571 scope.go:117] "RemoveContainer" containerID="70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b"
Sep 20 01:08:33.481492 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.481457    2571 generic.go:356] "Generic (PLEG): container finished" podID="407bb8cb-3056-420b-a254-3053766f3597" containerID="597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976" exitCode=0
Sep 20 01:08:33.481492 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.481485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr" event={"ID":"407bb8cb-3056-420b-a254-3053766f3597","Type":"ContainerDied","Data":"597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976"}
Sep 20 01:08:33.481632 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.481503    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"
Sep 20 01:08:33.481632 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.481542    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr" event={"ID":"407bb8cb-3056-420b-a254-3053766f3597","Type":"ContainerDied","Data":"9648e8bb534b180348f899c8f2bc0dd382dd891bfb1e7da06f8cd837a1fde1c3"}
Sep 20 01:08:33.490709 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.490694    2571 scope.go:117] "RemoveContainer" containerID="70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b"
Sep 20 01:08:33.490985 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:08:33.490963    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b\": container with ID starting with 70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b not found: ID does not exist" containerID="70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b"
Sep 20 01:08:33.491057 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.490994    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b"} err="failed to get container status \"70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b\": rpc error: code = NotFound desc = could not find container \"70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b\": container with ID starting with 70b2bdaf10410d0837d9152e601ae61f2889b2b2543969d2b855d5b064825e7b not found: ID does not exist"
Sep 20 01:08:33.491057 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.491010    2571 scope.go:117] "RemoveContainer" containerID="597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976"
Sep 20 01:08:33.498918 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.498900    2571 scope.go:117] "RemoveContainer" containerID="597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976"
Sep 20 01:08:33.499166 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:08:33.499143    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976\": container with ID starting with 597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976 not found: ID does not exist" containerID="597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976"
Sep 20 01:08:33.499241 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.499172    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976"} err="failed to get container status \"597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976\": rpc error: code = NotFound desc = could not find container \"597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976\": container with ID starting with 597c4a0690706f92040d682c982c3aa05106e1839b351fa6af478f91fd390976 not found: ID does not exist"
Sep 20 01:08:33.509459 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.509437    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="141d06b6-4975-45bd-9450-03ff100a9ebf" path="/var/lib/kubelet/pods/141d06b6-4975-45bd-9450-03ff100a9ebf/volumes"
Sep 20 01:08:33.509684 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.509671    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"]
Sep 20 01:08:33.509735 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.509695    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn"]
Sep 20 01:08:33.515540 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.515515    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"]
Sep 20 01:08:33.525167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.522952    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr"]
Sep 20 01:08:33.583946 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.583923    2571 scope.go:117] "RemoveContainer" containerID="69aa69d276f3ab94d6331ea602a8b31df863787ea4ffefb32d9eb6dd9c95d3b6"
Sep 20 01:08:33.833250 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:33.833216    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:34.634641 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:34.634609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:35.312836 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:35.312796    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:35.508555 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:35.508524    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" path="/var/lib/kubelet/pods/3f7a3182-e13f-4fdf-a8b6-98e5b77af27f/volumes"
Sep 20 01:08:35.508894 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:35.508881    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="407bb8cb-3056-420b-a254-3053766f3597" path="/var/lib/kubelet/pods/407bb8cb-3056-420b-a254-3053766f3597/volumes"
Sep 20 01:08:36.005989 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:36.005953    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:36.933999 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:36.933958    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:37.203677 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:37.203583    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:37.722603 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:37.722569    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:38.981410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:38.981372    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:39.109114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:39.109076    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:39.244356 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:39.244271    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"]
Sep 20 01:08:39.244525 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:39.244473    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy" containerID="cri-o://77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec" gracePeriod=30
Sep 20 01:08:39.268889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:39.268856    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:39.828392 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:39.828350    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:40.087829 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.087746    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"]
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088074    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e23e195-c32c-4f44-b14b-0763b8243ae2" containerName="main"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088085    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e23e195-c32c-4f44-b14b-0763b8243ae2" containerName="main"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088101    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141d06b6-4975-45bd-9450-03ff100a9ebf" containerName="revoke-keys"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088106    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="141d06b6-4975-45bd-9450-03ff100a9ebf" containerName="revoke-keys"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088116    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="407bb8cb-3056-420b-a254-3053766f3597" containerName="payload-pre-processing"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088121    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="407bb8cb-3056-420b-a254-3053766f3597" containerName="payload-pre-processing"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088134    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" containerName="payload-processing"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088140    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" containerName="payload-processing"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088204    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e23e195-c32c-4f44-b14b-0763b8243ae2" containerName="main"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088214    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="407bb8cb-3056-420b-a254-3053766f3597" containerName="payload-pre-processing"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088221    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f7a3182-e13f-4fdf-a8b6-98e5b77af27f" containerName="payload-processing"
Sep 20 01:08:40.088259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.088229    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="141d06b6-4975-45bd-9450-03ff100a9ebf" containerName="revoke-keys"
Sep 20 01:08:40.093044 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.093020    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.095631 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.095608    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-d1662a-openshift-default-dockercfg-zdvbz\""
Sep 20 01:08:40.105755 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.105729    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"]
Sep 20 01:08:40.112531 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.112503    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:40.207087 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207053    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-podinfo\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207087 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-certs\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207342 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istiod-ca-cert\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207342 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-envoy\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207342 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207234    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-socket\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207342 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gsnb\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-kube-api-access-5gsnb\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207342 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-data\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-token\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.207508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.207378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-credential-socket\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308188 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-token\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308216    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-credential-socket\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-podinfo\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-certs\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308331 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istiod-ca-cert\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-envoy\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-socket\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gsnb\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-kube-api-access-5gsnb\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308553 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308437    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-data\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308758 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-credential-socket\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308758 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308724    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-certs\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.308976 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.308956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-socket\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.309082 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.309062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-data\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.309131 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.309100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istiod-ca-cert\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.310777 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.310755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-envoy\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.310871 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.310821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-podinfo\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.315677 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.315658    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-token\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.315857 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.315835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gsnb\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-kube-api-access-5gsnb\") pod \"e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") " pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.337323 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.337298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:40.404954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.404903    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:40.680885 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.680677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"]
Sep 20 01:08:40.683518 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:08:40.683492    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c928423_1eb8_4cbc_a040_2cd1e6720c86.slice/crio-d7077197355e6f79da9ca0efccff632d3ea14aae052b2f26ca6441f21153c81b WatchSource:0}: Error finding container d7077197355e6f79da9ca0efccff632d3ea14aae052b2f26ca6441f21153c81b: Status 404 returned error can't find the container with id d7077197355e6f79da9ca0efccff632d3ea14aae052b2f26ca6441f21153c81b
Sep 20 01:08:40.685766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.685727    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:08:40.685839 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.685812    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:08:40.685877 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.685858    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:08:40.832542 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.832510    2571 patch_prober.go:28] interesting pod/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 01:08:40.832698 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:40.832572    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 01:08:41.529739 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:41.529705    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" event={"ID":"9c928423-1eb8-4cbc-a040-2cd1e6720c86","Type":"ContainerStarted","Data":"59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5"}
Sep 20 01:08:41.530219 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:41.529749    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" event={"ID":"9c928423-1eb8-4cbc-a040-2cd1e6720c86","Type":"ContainerStarted","Data":"d7077197355e6f79da9ca0efccff632d3ea14aae052b2f26ca6441f21153c81b"}
Sep 20 01:08:41.548749 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:41.548706    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" podStartSLOduration=1.5486905420000001 podStartE2EDuration="1.548690542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:08:41.546861461 +0000 UTC m=+1268.540137018" watchObservedRunningTime="2026-09-20 01:08:41.548690542 +0000 UTC m=+1268.541966074"
Sep 20 01:08:42.198757 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:42.198722    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:08:42.405412 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:42.405385    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:42.410719 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:42.410694    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:42.535407 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:42.535383    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:42.536418 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:42.536398    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:08:42.829356 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:42.829272    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:43.517414 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:43.517379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:43.622468 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:43.622436    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:43.720471 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:43.720445    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:44.366137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.366104    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:44.490161 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.490132    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:08:44.546563 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.546493    2571 generic.go:356] "Generic (PLEG): container finished" podID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerID="77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec" exitCode=0
Sep 20 01:08:44.546563 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.546537    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"
Sep 20 01:08:44.546760 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.546573    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" event={"ID":"3c1cbabe-b109-4b5d-8fee-77663eda021f","Type":"ContainerDied","Data":"77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec"}
Sep 20 01:08:44.546760 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.546628    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh" event={"ID":"3c1cbabe-b109-4b5d-8fee-77663eda021f","Type":"ContainerDied","Data":"006bc279927e2794a49dd33fcaa18af2c9831e9e1f11b6af118b05073fe02bce"}
Sep 20 01:08:44.546760 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.546661    2571 scope.go:117] "RemoveContainer" containerID="77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec"
Sep 20 01:08:44.555132 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.555116    2571 scope.go:117] "RemoveContainer" containerID="0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee"
Sep 20 01:08:44.562397 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.562380    2571 scope.go:117] "RemoveContainer" containerID="77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec"
Sep 20 01:08:44.562661 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:08:44.562642    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec\": container with ID starting with 77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec not found: ID does not exist" containerID="77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec"
Sep 20 01:08:44.562709 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.562669    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec"} err="failed to get container status \"77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec\": rpc error: code = NotFound desc = could not find container \"77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec\": container with ID starting with 77b755c78ed3629485b2931eb1cc21bdcd67ad97471ef161fd4dcb05ea0a41ec not found: ID does not exist"
Sep 20 01:08:44.562709 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.562684    2571 scope.go:117] "RemoveContainer" containerID="0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee"
Sep 20 01:08:44.562910 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:08:44.562893    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee\": container with ID starting with 0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee not found: ID does not exist" containerID="0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee"
Sep 20 01:08:44.562956 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.562915    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee"} err="failed to get container status \"0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee\": rpc error: code = NotFound desc = could not find container \"0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee\": container with ID starting with 0f714cac36d1dbf3e719225f31c6e9dc7a75cb765e7d555360bbf63625b68fee not found: ID does not exist"
Sep 20 01:08:44.645274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645251    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-envoy\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645283    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-socket\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645326    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cbabe-b109-4b5d-8fee-77663eda021f-istiod-ca-cert\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645349    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-credential-socket\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645366    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-data\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645381    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-token\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645415    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-certs\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645467    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k92m2\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-kube-api-access-k92m2\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.645644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645528    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-podinfo\") pod \"3c1cbabe-b109-4b5d-8fee-77663eda021f\" (UID: \"3c1cbabe-b109-4b5d-8fee-77663eda021f\") "
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645675    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645688    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645697    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645758    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1cbabe-b109-4b5d-8fee-77663eda021f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645963    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645983    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cbabe-b109-4b5d-8fee-77663eda021f-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.645997    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.646028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.646011    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.646473 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.646132    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:44.647530 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.647507    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:44.647760 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.647740    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:08:44.647962 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.647944    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:44.647962 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.647954    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-kube-api-access-k92m2" (OuterVolumeSpecName: "kube-api-access-k92m2") pod "3c1cbabe-b109-4b5d-8fee-77663eda021f" (UID: "3c1cbabe-b109-4b5d-8fee-77663eda021f"). InnerVolumeSpecName "kube-api-access-k92m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:44.747389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.747352    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.747389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.747387    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.747527 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.747400    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.747527 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.747412    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1cbabe-b109-4b5d-8fee-77663eda021f-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.747527 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.747424    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k92m2\" (UniqueName: \"kubernetes.io/projected/3c1cbabe-b109-4b5d-8fee-77663eda021f-kube-api-access-k92m2\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:08:44.876479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.876450    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"]
Sep 20 01:08:44.889850 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:44.889821    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh"]
Sep 20 01:08:45.350827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:45.350802    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:45.509661 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:45.509625    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" path="/var/lib/kubelet/pods/3c1cbabe-b109-4b5d-8fee-77663eda021f/volumes"
Sep 20 01:08:46.034413 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:46.034379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:46.721257 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:46.721229    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:47.381248 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:47.381217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:47.554542 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:47.554510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:47.655537 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:47.655421    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:47.755595 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:47.755554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:48.028067 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.028031    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:48.112569 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.112530    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:48.132849 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.132824    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"]
Sep 20 01:08:48.133180 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.133168    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy"
Sep 20 01:08:48.133251 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.133182    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy"
Sep 20 01:08:48.133297 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.133287    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy"
Sep 20 01:08:48.137629 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.137613    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.140060 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.140036    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-d1662a\""
Sep 20 01:08:48.140060 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.140037    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-d1662a-dockercfg-vjzzr\""
Sep 20 01:08:48.144978 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.144951    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"]
Sep 20 01:08:48.177103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.177079    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"]
Sep 20 01:08:48.177435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.177419    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy"
Sep 20 01:08:48.177435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.177434    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy"
Sep 20 01:08:48.177583 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.177507    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1cbabe-b109-4b5d-8fee-77663eda021f" containerName="istio-proxy"
Sep 20 01:08:48.180364 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.180349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.190521 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.190501    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"]
Sep 20 01:08:48.279225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.279133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.279225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.279172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcrhc\" (UniqueName: \"kubernetes.io/projected/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-kube-api-access-dcrhc\") pod \"payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.279225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.279215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjx2\" (UniqueName: \"kubernetes.io/projected/2214e248-39f1-4be7-b895-85547a4a1e67-kube-api-access-zwjx2\") pod \"payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.279440 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.279317    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2214e248-39f1-4be7-b895-85547a4a1e67-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.379946 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.379921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2214e248-39f1-4be7-b895-85547a4a1e67-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.380062 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.379983    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.380062 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.380003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcrhc\" (UniqueName: \"kubernetes.io/projected/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-kube-api-access-dcrhc\") pod \"payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.380137 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.380092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjx2\" (UniqueName: \"kubernetes.io/projected/2214e248-39f1-4be7-b895-85547a4a1e67-kube-api-access-zwjx2\") pod \"payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.380867 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.380844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2214e248-39f1-4be7-b895-85547a4a1e67-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.380918 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.380844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.392520 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.392497    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjx2\" (UniqueName: \"kubernetes.io/projected/2214e248-39f1-4be7-b895-85547a4a1e67-kube-api-access-zwjx2\") pod \"payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.393134 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.393114    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcrhc\" (UniqueName: \"kubernetes.io/projected/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-kube-api-access-dcrhc\") pod \"payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.450288 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.450265    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:48.491328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.491281    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:48.728385 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.728352    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"]
Sep 20 01:08:48.731580 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:08:48.731553    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2214e248_39f1_4be7_b895_85547a4a1e67.slice/crio-2d51e022c11ad07d3e30d63957e8783bcb131c391c0cd4783c4c9707c9b23fb6 WatchSource:0}: Error finding container 2d51e022c11ad07d3e30d63957e8783bcb131c391c0cd4783c4c9707c9b23fb6: Status 404 returned error can't find the container with id 2d51e022c11ad07d3e30d63957e8783bcb131c391c0cd4783c4c9707c9b23fb6
Sep 20 01:08:48.770327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:48.770301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"]
Sep 20 01:08:49.573757 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.573719    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q" event={"ID":"264cc2e1-a9d3-4ef5-9181-74e98c6a8519","Type":"ContainerStarted","Data":"18e09634a107ea5b45e7ebe84b85eab209f515e9c2635daa6178e0395228520c"}
Sep 20 01:08:49.574147 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.573773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q" event={"ID":"264cc2e1-a9d3-4ef5-9181-74e98c6a8519","Type":"ContainerStarted","Data":"ae60ec05b11eb1d0e305438672901c68f163729d3957c8c93df4c701de65acfc"}
Sep 20 01:08:49.574147 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.573835    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:08:49.575451 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.575426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848" event={"ID":"2214e248-39f1-4be7-b895-85547a4a1e67","Type":"ContainerStarted","Data":"7cd7afc0f5b170b3521dffa335e6dba03eb081a298fdf41e7777e6d6b8ad9343"}
Sep 20 01:08:49.575577 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.575468    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848" event={"ID":"2214e248-39f1-4be7-b895-85547a4a1e67","Type":"ContainerStarted","Data":"2d51e022c11ad07d3e30d63957e8783bcb131c391c0cd4783c4c9707c9b23fb6"}
Sep 20 01:08:49.575577 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.575566    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:08:49.590641 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.590590    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q" podStartSLOduration=1.5905759929999999 podStartE2EDuration="1.590575993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:08:49.589031317 +0000 UTC m=+1276.582306860" watchObservedRunningTime="2026-09-20 01:08:49.590575993 +0000 UTC m=+1276.583851546"
Sep 20 01:08:49.605178 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:49.605138    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848" podStartSLOduration=1.605124907 podStartE2EDuration="1.605124907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:08:49.603126689 +0000 UTC m=+1276.596402221" watchObservedRunningTime="2026-09-20 01:08:49.605124907 +0000 UTC m=+1276.598400440"
Sep 20 01:08:53.981697 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:53.981664    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"]
Sep 20 01:08:53.985290 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:53.985271    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:53.987696 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:53.987671    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8b864c4f\"/\"kube-root-ca.crt\""
Sep 20 01:08:53.988889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:53.988866    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8b864c4f\"/\"openshift-service-ca.crt\""
Sep 20 01:08:53.989010 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:53.988869    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8b864c4f\"/\"e2e-lifecycle-model-8b864c4f-kserve-self-signed-certs\""
Sep 20 01:08:53.989010 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:53.988876    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8b864c4f\"/\"default-dockercfg-s9nh8\""
Sep 20 01:08:53.993383 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:53.993344    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"]
Sep 20 01:08:54.034742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.034721    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tls-certs\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.034848 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.034746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-model-cache\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.034848 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.034783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-dshm\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.034931 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.034871    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tmp-dir\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.034931 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.034905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgkcq\" (UniqueName: \"kubernetes.io/projected/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-kube-api-access-xgkcq\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.035018 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.034943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-home\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136052 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgkcq\" (UniqueName: \"kubernetes.io/projected/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-kube-api-access-xgkcq\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-home\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tls-certs\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-model-cache\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-dshm\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136430 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tmp-dir\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136531 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136507    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-home\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136531 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136522    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-model-cache\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.136681 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.136587    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tmp-dir\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.138423 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.138402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-dshm\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.138683 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.138664    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tls-certs\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.144795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.144769    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgkcq\" (UniqueName: \"kubernetes.io/projected/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-kube-api-access-xgkcq\") pod \"e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") " pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.295825 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.295798    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:08:54.386544 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.386513    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:08:54.572176 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.572151    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"]
Sep 20 01:08:54.573867 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:08:54.573844    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41883a4c_ca74_49d0_a33e_0d4bb5e56e94.slice/crio-d177a10fdc25534305401815389d4126b0a24b44775e3ae110596b8683a1aa3b WatchSource:0}: Error finding container d177a10fdc25534305401815389d4126b0a24b44775e3ae110596b8683a1aa3b: Status 404 returned error can't find the container with id d177a10fdc25534305401815389d4126b0a24b44775e3ae110596b8683a1aa3b
Sep 20 01:08:54.601501 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:54.601478    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt" event={"ID":"41883a4c-ca74-49d0-a33e-0d4bb5e56e94","Type":"ContainerStarted","Data":"d177a10fdc25534305401815389d4126b0a24b44775e3ae110596b8683a1aa3b"}
Sep 20 01:08:55.608260 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:55.608225    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt" event={"ID":"41883a4c-ca74-49d0-a33e-0d4bb5e56e94","Type":"ContainerStarted","Data":"6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706"}
Sep 20 01:08:55.625600 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:08:55.625551    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt" podStartSLOduration=2.625536624 podStartE2EDuration="2.625536624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:08:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:08:55.623619046 +0000 UTC m=+1282.616894592" watchObservedRunningTime="2026-09-20 01:08:55.625536624 +0000 UTC m=+1282.618812156"
Sep 20 01:09:00.583228 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:00.583174    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:09:00.583741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:00.583275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:09:04.296172 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:04.296139    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:09:04.296643 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:04.296214    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:09:04.313800 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:04.313773    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:09:04.666941 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:04.666861    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:09:05.664865 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:05.664834    2571 generic.go:356] "Generic (PLEG): container finished" podID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerID="59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5" exitCode=0
Sep 20 01:09:05.665350 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:05.664910    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" event={"ID":"9c928423-1eb8-4cbc-a040-2cd1e6720c86","Type":"ContainerDied","Data":"59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5"}
Sep 20 01:09:05.665492 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:05.665475    2571 scope.go:117] "RemoveContainer" containerID="59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5"
Sep 20 01:09:05.666568 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:05.666538    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:09:05.666661 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:05.666618    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:09:05.666723 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:05.666669    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:09:06.671632 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:06.671596    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" event={"ID":"9c928423-1eb8-4cbc-a040-2cd1e6720c86","Type":"ContainerStarted","Data":"8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e"}
Sep 20 01:09:07.405090 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:07.405053    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:09:07.405424 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:07.405398    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 20 01:09:07.405530 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:07.405455    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 20 01:09:08.405651 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:08.405611    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 20 01:09:08.406040 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:08.405673    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 20 01:09:09.405653 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:09.405616    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 20 01:09:09.406056 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:09.405677    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 20 01:09:09.612438 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:09.612390    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:10.405838 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:10.405753    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 20 01:09:10.405838 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:10.405807    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 20 01:09:10.433348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:10.433321    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:11.109983 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:11.109943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:11.405711 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:11.405624    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 20 01:09:11.405711 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:11.405680    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 20 01:09:11.830807 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:11.830764    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:12.410561 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:12.410534    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:09:12.410962 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:12.410900    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:09:12.411627 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:12.411609    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:09:12.533139 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:12.533112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:13.217015 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:13.216976    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:13.407589 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:13.407553    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:09:13.513002 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:13.512966    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:13.840295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:13.840184    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:14.151620 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:14.151516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:14.250692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:14.250658    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:14.362354 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:14.362313    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:17.126180 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:17.126145    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:17.507943 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:17.507899    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:17.614971 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:17.614938    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:18.134228 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:18.134172    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:18.830277 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:18.830243    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:19.528145 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:19.528112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:20.330708 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:20.330663    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:21.095885 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:21.095841    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:21.939295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:21.939263    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:21.991202 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:21.991166    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:22.096942 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.096908    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:22.414058 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.414031    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:22.502857 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.502828    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:22.518882 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.518853    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"]
Sep 20 01:09:22.521861 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.521841    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.524113 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.524094    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-4c93ee\""
Sep 20 01:09:22.533244 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.533224    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"]
Sep 20 01:09:22.546552 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.546523    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"]
Sep 20 01:09:22.548945 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.548930    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:22.551301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.551283    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-4c93ee-dockercfg-kzh74\""
Sep 20 01:09:22.559324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.559301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"]
Sep 20 01:09:22.610675 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.610645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kssg9\" (UniqueName: \"kubernetes.io/projected/6d078c0f-02e6-4062-8b8b-9a33ed322085-kube-api-access-kssg9\") pod \"payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.610803 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.610741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d078c0f-02e6-4062-8b8b-9a33ed322085-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.711382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.711301    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kssg9\" (UniqueName: \"kubernetes.io/projected/6d078c0f-02e6-4062-8b8b-9a33ed322085-kube-api-access-kssg9\") pod \"payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.711382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.711348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b660953-d498-44d8-91cd-71677e75fcfb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:22.711382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.711371    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8dqh\" (UniqueName: \"kubernetes.io/projected/1b660953-d498-44d8-91cd-71677e75fcfb-kube-api-access-p8dqh\") pod \"payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:22.711592 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.711425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d078c0f-02e6-4062-8b8b-9a33ed322085-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.712077 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.712056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d078c0f-02e6-4062-8b8b-9a33ed322085-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.718774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.718751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kssg9\" (UniqueName: \"kubernetes.io/projected/6d078c0f-02e6-4062-8b8b-9a33ed322085-kube-api-access-kssg9\") pod \"payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.812154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.812117    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b660953-d498-44d8-91cd-71677e75fcfb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:22.812154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.812159    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8dqh\" (UniqueName: \"kubernetes.io/projected/1b660953-d498-44d8-91cd-71677e75fcfb-kube-api-access-p8dqh\") pod \"payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:22.812793 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.812772    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b660953-d498-44d8-91cd-71677e75fcfb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:22.820021 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.819998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8dqh\" (UniqueName: \"kubernetes.io/projected/1b660953-d498-44d8-91cd-71677e75fcfb-kube-api-access-p8dqh\") pod \"payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:22.832910 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.832889    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:22.860104 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:22.860077    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:23.105358 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.105332    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"]
Sep 20 01:09:23.107118 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:09:23.107092    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d078c0f_02e6_4062_8b8b_9a33ed322085.slice/crio-17e7c48777095935bad5a85ec0a26d1fd76774af069acf7f3976947901b6b493 WatchSource:0}: Error finding container 17e7c48777095935bad5a85ec0a26d1fd76774af069acf7f3976947901b6b493: Status 404 returned error can't find the container with id 17e7c48777095935bad5a85ec0a26d1fd76774af069acf7f3976947901b6b493
Sep 20 01:09:23.139175 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.139153    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"]
Sep 20 01:09:23.141108 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:09:23.141077    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b660953_d498_44d8_91cd_71677e75fcfb.slice/crio-ec28d6ec1c42d7238d2e528a80b3d30a1bee635478c8e2467687a46325bcd80e WatchSource:0}: Error finding container ec28d6ec1c42d7238d2e528a80b3d30a1bee635478c8e2467687a46325bcd80e: Status 404 returned error can't find the container with id ec28d6ec1c42d7238d2e528a80b3d30a1bee635478c8e2467687a46325bcd80e
Sep 20 01:09:23.761116 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.761081    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm" event={"ID":"1b660953-d498-44d8-91cd-71677e75fcfb","Type":"ContainerStarted","Data":"abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b"}
Sep 20 01:09:23.761327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.761139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm" event={"ID":"1b660953-d498-44d8-91cd-71677e75fcfb","Type":"ContainerStarted","Data":"ec28d6ec1c42d7238d2e528a80b3d30a1bee635478c8e2467687a46325bcd80e"}
Sep 20 01:09:23.761327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.761168    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:23.762841 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.762813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2" event={"ID":"6d078c0f-02e6-4062-8b8b-9a33ed322085","Type":"ContainerStarted","Data":"9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7"}
Sep 20 01:09:23.762948 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.762867    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2" event={"ID":"6d078c0f-02e6-4062-8b8b-9a33ed322085","Type":"ContainerStarted","Data":"17e7c48777095935bad5a85ec0a26d1fd76774af069acf7f3976947901b6b493"}
Sep 20 01:09:23.762948 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.762892    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:23.778173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.778131    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm" podStartSLOduration=1.778117946 podStartE2EDuration="1.778117946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:09:23.775061271 +0000 UTC m=+1310.768336804" watchObservedRunningTime="2026-09-20 01:09:23.778117946 +0000 UTC m=+1310.771393479"
Sep 20 01:09:23.791309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:23.791269    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2" podStartSLOduration=1.79125487 podStartE2EDuration="1.79125487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:09:23.789886557 +0000 UTC m=+1310.783162103" watchObservedRunningTime="2026-09-20 01:09:23.79125487 +0000 UTC m=+1310.784530402"
Sep 20 01:09:25.487023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:25.486980    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:29.300173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:29.300138    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:34.770777 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:34.770745    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:09:34.771288 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:34.770903    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:09:37.013589 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:37.013550    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:09:38.602551 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:38.602520    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"]
Sep 20 01:09:38.622019 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:38.621986    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:44.817760 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:44.817713    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:45.507826 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:45.507784    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:46.330631 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:46.330586    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:47.018748 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:47.018712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:47.531241 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:47.531209    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:47.828688 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:47.828609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:48.514475 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:48.514444    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:49.181823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:49.181772    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:50.016952 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:50.016916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:52.401439 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:52.401402    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:09:53.621892 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.621860    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv" podUID="81458f7e-5155-41dc-9115-4eb8883b9d04" containerName="main" containerID="cri-o://d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c" gracePeriod=45
Sep 20 01:09:53.654875 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.654846    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv" podUID="81458f7e-5155-41dc-9115-4eb8883b9d04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": dial tcp 10.133.0.52:8000: connect: connection refused"
Sep 20 01:09:53.871154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.871126    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:09:53.926615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.926550    2571 generic.go:356] "Generic (PLEG): container finished" podID="81458f7e-5155-41dc-9115-4eb8883b9d04" containerID="d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c" exitCode=0
Sep 20 01:09:53.926615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.926583    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"
Sep 20 01:09:53.926615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.926608    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv" event={"ID":"81458f7e-5155-41dc-9115-4eb8883b9d04","Type":"ContainerDied","Data":"d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c"}
Sep 20 01:09:53.926844 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.926637    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv" event={"ID":"81458f7e-5155-41dc-9115-4eb8883b9d04","Type":"ContainerDied","Data":"7a2f0b5f70ff968417d5a924c4675ff8ab4cf80259725bb0026a4d1343d1b0f4"}
Sep 20 01:09:53.926844 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.926654    2571 scope.go:117] "RemoveContainer" containerID="d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c"
Sep 20 01:09:53.935011 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.934996    2571 scope.go:117] "RemoveContainer" containerID="d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c"
Sep 20 01:09:53.935292 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:09:53.935272    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c\": container with ID starting with d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c not found: ID does not exist" containerID="d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c"
Sep 20 01:09:53.935361 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.935298    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c"} err="failed to get container status \"d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c\": rpc error: code = NotFound desc = could not find container \"d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c\": container with ID starting with d362f853156cccc3b60667d4f9c19a427a756b1cdc52ad42ba84147eb697710c not found: ID does not exist"
Sep 20 01:09:53.976328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976306    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-tmp-dir\") pod \"81458f7e-5155-41dc-9115-4eb8883b9d04\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") "
Sep 20 01:09:53.976428 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976336    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-home\") pod \"81458f7e-5155-41dc-9115-4eb8883b9d04\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") "
Sep 20 01:09:53.976428 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976359    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81458f7e-5155-41dc-9115-4eb8883b9d04-tls-certs\") pod \"81458f7e-5155-41dc-9115-4eb8883b9d04\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") "
Sep 20 01:09:53.976428 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976398    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-dshm\") pod \"81458f7e-5155-41dc-9115-4eb8883b9d04\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") "
Sep 20 01:09:53.976570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976468    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-model-cache\") pod \"81458f7e-5155-41dc-9115-4eb8883b9d04\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") "
Sep 20 01:09:53.976570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976501    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdvk2\" (UniqueName: \"kubernetes.io/projected/81458f7e-5155-41dc-9115-4eb8883b9d04-kube-api-access-xdvk2\") pod \"81458f7e-5155-41dc-9115-4eb8883b9d04\" (UID: \"81458f7e-5155-41dc-9115-4eb8883b9d04\") "
Sep 20 01:09:53.976682 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976584    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "81458f7e-5155-41dc-9115-4eb8883b9d04" (UID: "81458f7e-5155-41dc-9115-4eb8883b9d04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:53.976682 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976598    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-home" (OuterVolumeSpecName: "home") pod "81458f7e-5155-41dc-9115-4eb8883b9d04" (UID: "81458f7e-5155-41dc-9115-4eb8883b9d04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:53.976788 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976769    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-model-cache" (OuterVolumeSpecName: "model-cache") pod "81458f7e-5155-41dc-9115-4eb8883b9d04" (UID: "81458f7e-5155-41dc-9115-4eb8883b9d04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:53.976921 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976902    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:09:53.976972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976928    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:09:53.976972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.976944    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:09:53.978533 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.978512    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81458f7e-5155-41dc-9115-4eb8883b9d04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "81458f7e-5155-41dc-9115-4eb8883b9d04" (UID: "81458f7e-5155-41dc-9115-4eb8883b9d04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:09:53.978619 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.978546    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81458f7e-5155-41dc-9115-4eb8883b9d04-kube-api-access-xdvk2" (OuterVolumeSpecName: "kube-api-access-xdvk2") pod "81458f7e-5155-41dc-9115-4eb8883b9d04" (UID: "81458f7e-5155-41dc-9115-4eb8883b9d04"). InnerVolumeSpecName "kube-api-access-xdvk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:09:53.978667 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:53.978615    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-dshm" (OuterVolumeSpecName: "dshm") pod "81458f7e-5155-41dc-9115-4eb8883b9d04" (UID: "81458f7e-5155-41dc-9115-4eb8883b9d04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:54.078345 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:54.078319    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdvk2\" (UniqueName: \"kubernetes.io/projected/81458f7e-5155-41dc-9115-4eb8883b9d04-kube-api-access-xdvk2\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:09:54.078345 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:54.078338    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81458f7e-5155-41dc-9115-4eb8883b9d04-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:09:54.078487 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:54.078354    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81458f7e-5155-41dc-9115-4eb8883b9d04-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:09:54.248113 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:54.248089    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"]
Sep 20 01:09:54.251485 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:54.251461    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-a-d774ddcf-kserve-74bf6dc5bd-z96cv"]
Sep 20 01:09:55.509756 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:09:55.509712    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81458f7e-5155-41dc-9115-4eb8883b9d04" path="/var/lib/kubelet/pods/81458f7e-5155-41dc-9115-4eb8883b9d04/volumes"
Sep 20 01:10:00.191920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.191884    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"]
Sep 20 01:10:00.192316 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.192301    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81458f7e-5155-41dc-9115-4eb8883b9d04" containerName="main"
Sep 20 01:10:00.192363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.192318    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="81458f7e-5155-41dc-9115-4eb8883b9d04" containerName="main"
Sep 20 01:10:00.192419 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.192409    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="81458f7e-5155-41dc-9115-4eb8883b9d04" containerName="main"
Sep 20 01:10:00.196987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.196969    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.199713 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.199692    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"kube-root-ca.crt\""
Sep 20 01:10:00.200697 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.200671    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"default-dockercfg-kp6ds\""
Sep 20 01:10:00.200816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.200704    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"openshift-service-ca.crt\""
Sep 20 01:10:00.200816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.200704    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"auth-test-model-d1662a-kserve-self-signed-certs\""
Sep 20 01:10:00.204821 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.204801    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"]
Sep 20 01:10:00.217266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.217243    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:00.332435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.332405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kb2m\" (UniqueName: \"kubernetes.io/projected/3919da3c-5f37-46c0-a3b2-8990562314c6-kube-api-access-7kb2m\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.332601 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.332440    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3919da3c-5f37-46c0-a3b2-8990562314c6-tls-certs\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.332601 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.332496    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-model-cache\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.332601 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.332551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-home\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.332760 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.332636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-dshm\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.332760 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.332674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-tmp-dir\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.433742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.433715    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-home\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.433872 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.433767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-dshm\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.433924 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.433878    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-tmp-dir\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.433984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.433936    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kb2m\" (UniqueName: \"kubernetes.io/projected/3919da3c-5f37-46c0-a3b2-8990562314c6-kube-api-access-7kb2m\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.433984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.433964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3919da3c-5f37-46c0-a3b2-8990562314c6-tls-certs\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.434089 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.434005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-model-cache\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.434274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.434254    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-home\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.434367 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.434274    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-tmp-dir\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.434367 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.434313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-model-cache\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.435998 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.435969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-dshm\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.436414 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.436392    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3919da3c-5f37-46c0-a3b2-8990562314c6-tls-certs\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.441558 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.441535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kb2m\" (UniqueName: \"kubernetes.io/projected/3919da3c-5f37-46c0-a3b2-8990562314c6-kube-api-access-7kb2m\") pod \"auth-test-model-d1662a-kserve-86c967dd59-g6xqd\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.508786 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.508765    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:00.780256 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.780233    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"]
Sep 20 01:10:00.782170 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:10:00.782147    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3919da3c_5f37_46c0_a3b2_8990562314c6.slice/crio-6b655158233cbe249a0fe4d51fde24c97ce4446213e45d55f990c7d56268b5ca WatchSource:0}: Error finding container 6b655158233cbe249a0fe4d51fde24c97ce4446213e45d55f990c7d56268b5ca: Status 404 returned error can't find the container with id 6b655158233cbe249a0fe4d51fde24c97ce4446213e45d55f990c7d56268b5ca
Sep 20 01:10:00.970072 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.970033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd" event={"ID":"3919da3c-5f37-46c0-a3b2-8990562314c6","Type":"ContainerStarted","Data":"f6f90030065a829e7a97e4653c67f0ec95f1c9cae1bc6b8c62edcf6667abfd2f"}
Sep 20 01:10:00.970272 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.970077    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd" event={"ID":"3919da3c-5f37-46c0-a3b2-8990562314c6","Type":"ContainerStarted","Data":"6b655158233cbe249a0fe4d51fde24c97ce4446213e45d55f990c7d56268b5ca"}
Sep 20 01:10:00.987823 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:00.987774    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd" podStartSLOduration=0.987758508 podStartE2EDuration="987.758508ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:10:00.985370395 +0000 UTC m=+1347.978645928" watchObservedRunningTime="2026-09-20 01:10:00.987758508 +0000 UTC m=+1347.981034069"
Sep 20 01:10:05.548898 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.548861    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"]
Sep 20 01:10:05.552179 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.552161    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"
Sep 20 01:10:05.554581 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.554557    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:10:05.554704 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.554557    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:10:05.559976 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.559948    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"]
Sep 20 01:10:05.682973 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.682945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c72c8df-e027-4f4b-9202-462d70509e97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2\" (UID: \"4c72c8df-e027-4f4b-9202-462d70509e97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"
Sep 20 01:10:05.784154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.784132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c72c8df-e027-4f4b-9202-462d70509e97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2\" (UID: \"4c72c8df-e027-4f4b-9202-462d70509e97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"
Sep 20 01:10:05.784728 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.784709    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c72c8df-e027-4f4b-9202-462d70509e97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2\" (UID: \"4c72c8df-e027-4f4b-9202-462d70509e97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"
Sep 20 01:10:05.830272 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.830205    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:05.864281 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:05.864247    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"
Sep 20 01:10:06.137887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:06.137860    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"]
Sep 20 01:10:06.139977 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:10:06.139952    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c72c8df_e027_4f4b_9202_462d70509e97.slice/crio-dfe0f5682799632a8d290e4f189ef8e4d16b48270a567d3e92f31b48504d210b WatchSource:0}: Error finding container dfe0f5682799632a8d290e4f189ef8e4d16b48270a567d3e92f31b48504d210b: Status 404 returned error can't find the container with id dfe0f5682799632a8d290e4f189ef8e4d16b48270a567d3e92f31b48504d210b
Sep 20 01:10:06.734023 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:06.733947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:07.006777 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:07.006746    2571 generic.go:356] "Generic (PLEG): container finished" podID="4c72c8df-e027-4f4b-9202-462d70509e97" containerID="aabd414530a72b225b31cbc30913c5f0550d993194e0f99985dd5b3a9b7db572" exitCode=0
Sep 20 01:10:07.006923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:07.006833    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2" event={"ID":"4c72c8df-e027-4f4b-9202-462d70509e97","Type":"ContainerDied","Data":"aabd414530a72b225b31cbc30913c5f0550d993194e0f99985dd5b3a9b7db572"}
Sep 20 01:10:07.006923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:07.006885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2" event={"ID":"4c72c8df-e027-4f4b-9202-462d70509e97","Type":"ContainerStarted","Data":"dfe0f5682799632a8d290e4f189ef8e4d16b48270a567d3e92f31b48504d210b"}
Sep 20 01:10:07.423333 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:07.423257    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:08.097745 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:08.097711    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:08.152596 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:08.152568    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"
Sep 20 01:10:08.308496 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:08.308424    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c72c8df-e027-4f4b-9202-462d70509e97-maas-api-service-ca\") pod \"4c72c8df-e027-4f4b-9202-462d70509e97\" (UID: \"4c72c8df-e027-4f4b-9202-462d70509e97\") "
Sep 20 01:10:08.308768 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:08.308746    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c72c8df-e027-4f4b-9202-462d70509e97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c72c8df-e027-4f4b-9202-462d70509e97" (UID: "4c72c8df-e027-4f4b-9202-462d70509e97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:10:08.409572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:08.409548    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c72c8df-e027-4f4b-9202-462d70509e97-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:08.840227 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:08.840175    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:09.019505 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:09.019481    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"
Sep 20 01:10:09.019505 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:09.019489    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2" event={"ID":"4c72c8df-e027-4f4b-9202-462d70509e97","Type":"ContainerDied","Data":"dfe0f5682799632a8d290e4f189ef8e4d16b48270a567d3e92f31b48504d210b"}
Sep 20 01:10:09.019704 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:09.019539    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfe0f5682799632a8d290e4f189ef8e4d16b48270a567d3e92f31b48504d210b"
Sep 20 01:10:09.525125 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:09.525070    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:10.342661 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:10.342626    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:10.509820 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:10.509787    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:10.509820 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:10.509822    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:10.522106 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:10.522085    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:11.022867 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:11.022825    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:11.042431 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:11.042407    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:10:11.828240 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:11.828181    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:18.799816 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:18.799780    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:10:21.273505 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.273446    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:21.300899 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.300865    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"]
Sep 20 01:10:21.301309 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.301271    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f" podUID="bc488eb7-02ec-46eb-9a65-c12f4a9aad74" containerName="payload-processing" containerID="cri-o://5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef" gracePeriod=30
Sep 20 01:10:21.374140 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.374111    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:21.466182 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.466141    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"]
Sep 20 01:10:21.469028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.468994    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:21.469413 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.469393    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8b864c4f-24sp2"]
Sep 20 01:10:21.511839 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.511814    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c72c8df-e027-4f4b-9202-462d70509e97" path="/var/lib/kubelet/pods/4c72c8df-e027-4f4b-9202-462d70509e97/volumes"
Sep 20 01:10:21.529100 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.529039    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:21.570289 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.570260    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:10:21.619837 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.619814    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-plugins-config-volume\") pod \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") "
Sep 20 01:10:21.620001 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.619851    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9qhz\" (UniqueName: \"kubernetes.io/projected/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-kube-api-access-m9qhz\") pod \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\" (UID: \"bc488eb7-02ec-46eb-9a65-c12f4a9aad74\") "
Sep 20 01:10:21.620250 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.620221    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc488eb7-02ec-46eb-9a65-c12f4a9aad74" (UID: "bc488eb7-02ec-46eb-9a65-c12f4a9aad74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:10:21.622572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.622549    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-kube-api-access-m9qhz" (OuterVolumeSpecName: "kube-api-access-m9qhz") pod "bc488eb7-02ec-46eb-9a65-c12f4a9aad74" (UID: "bc488eb7-02ec-46eb-9a65-c12f4a9aad74"). InnerVolumeSpecName "kube-api-access-m9qhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:10:21.720625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.720599    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.720625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.720624    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9qhz\" (UniqueName: \"kubernetes.io/projected/bc488eb7-02ec-46eb-9a65-c12f4a9aad74-kube-api-access-m9qhz\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.970965 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:21.970896    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:22.090749 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.090715    2571 generic.go:356] "Generic (PLEG): container finished" podID="bc488eb7-02ec-46eb-9a65-c12f4a9aad74" containerID="5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef" exitCode=0
Sep 20 01:10:22.090874 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.090757    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"
Sep 20 01:10:22.090874 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.090808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f" event={"ID":"bc488eb7-02ec-46eb-9a65-c12f4a9aad74","Type":"ContainerDied","Data":"5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef"}
Sep 20 01:10:22.090874 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.090858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f" event={"ID":"bc488eb7-02ec-46eb-9a65-c12f4a9aad74","Type":"ContainerDied","Data":"f16bafd3fc5969c129905fd8b64c91d887d8eb5f22ae0375f58110517ac3ef4c"}
Sep 20 01:10:22.090983 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.090880    2571 scope.go:117] "RemoveContainer" containerID="5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef"
Sep 20 01:10:22.099953 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.099938    2571 scope.go:117] "RemoveContainer" containerID="5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef"
Sep 20 01:10:22.100208 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:10:22.100172    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef\": container with ID starting with 5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef not found: ID does not exist" containerID="5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef"
Sep 20 01:10:22.100254 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.100217    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef"} err="failed to get container status \"5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef\": rpc error: code = NotFound desc = could not find container \"5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef\": container with ID starting with 5bda41e57d95c74711be6bdc691792f42075e934470e95696c196354817106ef not found: ID does not exist"
Sep 20 01:10:22.112932 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.112912    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"]
Sep 20 01:10:22.116439 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.116419    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f"]
Sep 20 01:10:22.695609 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:22.695568    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:23.370927 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:23.370896    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:23.509733 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:23.509689    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc488eb7-02ec-46eb-9a65-c12f4a9aad74" path="/var/lib/kubelet/pods/bc488eb7-02ec-46eb-9a65-c12f4a9aad74/volumes"
Sep 20 01:10:24.216185 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:24.216157    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:24.610780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:24.610752    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:24.925493 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:24.925426    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:25.694983 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:25.694954    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:26.431576 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:26.431540    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:28.483226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.483178    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"]
Sep 20 01:10:28.483725 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.483709    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc488eb7-02ec-46eb-9a65-c12f4a9aad74" containerName="payload-processing"
Sep 20 01:10:28.483770 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.483729    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc488eb7-02ec-46eb-9a65-c12f4a9aad74" containerName="payload-processing"
Sep 20 01:10:28.483770 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.483754    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c72c8df-e027-4f4b-9202-462d70509e97" containerName="revoke-keys"
Sep 20 01:10:28.483770 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.483764    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c72c8df-e027-4f4b-9202-462d70509e97" containerName="revoke-keys"
Sep 20 01:10:28.483901 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.483889    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c72c8df-e027-4f4b-9202-462d70509e97" containerName="revoke-keys"
Sep 20 01:10:28.483940 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.483902    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc488eb7-02ec-46eb-9a65-c12f4a9aad74" containerName="payload-processing"
Sep 20 01:10:28.488585 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.488523    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.491946 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.491924    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"distinct-2-w4-4e301e-kserve-self-signed-certs\""
Sep 20 01:10:28.493453 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.493430    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"]
Sep 20 01:10:28.502209 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.502169    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:28.573357 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.573332    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbeef66-98de-45de-83f0-95c24fd64594-tls-certs\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.573451 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.573360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzscx\" (UniqueName: \"kubernetes.io/projected/dfbeef66-98de-45de-83f0-95c24fd64594-kube-api-access-mzscx\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.573451 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.573384    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-model-cache\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.573596 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.573578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-home\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.573632 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.573612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-dshm\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.573714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.573702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-tmp-dir\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.674684 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.674663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-dshm\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.674908 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.674888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-tmp-dir\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.675121 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.675101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbeef66-98de-45de-83f0-95c24fd64594-tls-certs\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.675637 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.675615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzscx\" (UniqueName: \"kubernetes.io/projected/dfbeef66-98de-45de-83f0-95c24fd64594-kube-api-access-mzscx\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.675792 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.675775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-model-cache\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.675917 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.675902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-home\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.676391 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.676343    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-model-cache\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.676586 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.675237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-tmp-dir\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.676914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.676883    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-home\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.677678 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.677654    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-dshm\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.678484 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.678466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbeef66-98de-45de-83f0-95c24fd64594-tls-certs\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.685150 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.685128    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzscx\" (UniqueName: \"kubernetes.io/projected/dfbeef66-98de-45de-83f0-95c24fd64594-kube-api-access-mzscx\") pod \"distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:28.800749 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:28.800729    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:29.070652 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:29.070628    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"]
Sep 20 01:10:29.072140 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:10:29.072116    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfbeef66_98de_45de_83f0_95c24fd64594.slice/crio-377c6be395c96149fb9720bef03f44aa88b34a00af647c60b94f8a1ea0ef352f WatchSource:0}: Error finding container 377c6be395c96149fb9720bef03f44aa88b34a00af647c60b94f8a1ea0ef352f: Status 404 returned error can't find the container with id 377c6be395c96149fb9720bef03f44aa88b34a00af647c60b94f8a1ea0ef352f
Sep 20 01:10:29.127911 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:29.127883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4" event={"ID":"dfbeef66-98de-45de-83f0-95c24fd64594","Type":"ContainerStarted","Data":"377c6be395c96149fb9720bef03f44aa88b34a00af647c60b94f8a1ea0ef352f"}
Sep 20 01:10:29.591410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:29.591379    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"]
Sep 20 01:10:29.687595 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:29.687565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:30.134851 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:30.134822    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4" event={"ID":"dfbeef66-98de-45de-83f0-95c24fd64594","Type":"ContainerStarted","Data":"9d80caef94e09de38ac318505d60a9b03d6532f81153e2c26db3bc9a3ea162fd"}
Sep 20 01:10:30.150475 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:30.150433    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4" podStartSLOduration=2.150418211 podStartE2EDuration="2.150418211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:10:30.149410824 +0000 UTC m=+1377.142686357" watchObservedRunningTime="2026-09-20 01:10:30.150418211 +0000 UTC m=+1377.143693743"
Sep 20 01:10:38.801914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:38.801883    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:38.802312 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:38.801925    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:38.813529 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:38.813509    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:39.189472 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:39.189409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:10:44.616340 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.616301    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt" podUID="41883a4c-ca74-49d0-a33e-0d4bb5e56e94" containerName="main" containerID="cri-o://6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706" gracePeriod=45
Sep 20 01:10:44.656991 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.656956    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt" podUID="41883a4c-ca74-49d0-a33e-0d4bb5e56e94" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": dial tcp 10.133.0.61:8000: connect: connection refused"
Sep 20 01:10:44.852732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.852709    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:10:44.912980 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.912913    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-dshm\") pod \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") "
Sep 20 01:10:44.913118 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913003    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-home\") pod \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") "
Sep 20 01:10:44.913118 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913037    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tls-certs\") pod \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") "
Sep 20 01:10:44.913118 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913060    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tmp-dir\") pod \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") "
Sep 20 01:10:44.913118 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913097    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgkcq\" (UniqueName: \"kubernetes.io/projected/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-kube-api-access-xgkcq\") pod \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") "
Sep 20 01:10:44.913346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913160    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-model-cache\") pod \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\" (UID: \"41883a4c-ca74-49d0-a33e-0d4bb5e56e94\") "
Sep 20 01:10:44.913346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913264    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-home" (OuterVolumeSpecName: "home") pod "41883a4c-ca74-49d0-a33e-0d4bb5e56e94" (UID: "41883a4c-ca74-49d0-a33e-0d4bb5e56e94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:10:44.913452 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913342    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41883a4c-ca74-49d0-a33e-0d4bb5e56e94" (UID: "41883a4c-ca74-49d0-a33e-0d4bb5e56e94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:10:44.913524 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913501    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-model-cache" (OuterVolumeSpecName: "model-cache") pod "41883a4c-ca74-49d0-a33e-0d4bb5e56e94" (UID: "41883a4c-ca74-49d0-a33e-0d4bb5e56e94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:10:44.913634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913620    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:44.913694 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913639    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:44.913694 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.913652    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:44.915115 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.915092    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-dshm" (OuterVolumeSpecName: "dshm") pod "41883a4c-ca74-49d0-a33e-0d4bb5e56e94" (UID: "41883a4c-ca74-49d0-a33e-0d4bb5e56e94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:10:44.915503 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.915481    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41883a4c-ca74-49d0-a33e-0d4bb5e56e94" (UID: "41883a4c-ca74-49d0-a33e-0d4bb5e56e94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:10:44.915588 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:44.915487    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-kube-api-access-xgkcq" (OuterVolumeSpecName: "kube-api-access-xgkcq") pod "41883a4c-ca74-49d0-a33e-0d4bb5e56e94" (UID: "41883a4c-ca74-49d0-a33e-0d4bb5e56e94"). InnerVolumeSpecName "kube-api-access-xgkcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:10:45.015013 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.014985    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:45.015013 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.015010    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:45.015140 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.015025    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgkcq\" (UniqueName: \"kubernetes.io/projected/41883a4c-ca74-49d0-a33e-0d4bb5e56e94-kube-api-access-xgkcq\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:10:45.211496 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.211435    2571 generic.go:356] "Generic (PLEG): container finished" podID="41883a4c-ca74-49d0-a33e-0d4bb5e56e94" containerID="6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706" exitCode=0
Sep 20 01:10:45.211496 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.211478    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"
Sep 20 01:10:45.211659 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.211509    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt" event={"ID":"41883a4c-ca74-49d0-a33e-0d4bb5e56e94","Type":"ContainerDied","Data":"6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706"}
Sep 20 01:10:45.211659 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.211549    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt" event={"ID":"41883a4c-ca74-49d0-a33e-0d4bb5e56e94","Type":"ContainerDied","Data":"d177a10fdc25534305401815389d4126b0a24b44775e3ae110596b8683a1aa3b"}
Sep 20 01:10:45.211659 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.211572    2571 scope.go:117] "RemoveContainer" containerID="6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706"
Sep 20 01:10:45.221920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.221896    2571 scope.go:117] "RemoveContainer" containerID="6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706"
Sep 20 01:10:45.222237 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:10:45.222219    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706\": container with ID starting with 6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706 not found: ID does not exist" containerID="6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706"
Sep 20 01:10:45.222288 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.222247    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706"} err="failed to get container status \"6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706\": rpc error: code = NotFound desc = could not find container \"6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706\": container with ID starting with 6e69c3b4f9ff36dc27a2553344774a803bf9deebad9011329e09ae8af4882706 not found: ID does not exist"
Sep 20 01:10:45.235116 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.235096    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"]
Sep 20 01:10:45.239076 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.239055    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8b864c4f/e2e-lifecycle-model-8b864c4f-kserve-77648c685f-87hpt"]
Sep 20 01:10:45.509005 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:45.508980    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41883a4c-ca74-49d0-a33e-0d4bb5e56e94" path="/var/lib/kubelet/pods/41883a4c-ca74-49d0-a33e-0d4bb5e56e94/volumes"
Sep 20 01:10:48.191338 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.191302    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"]
Sep 20 01:10:48.191808 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.191657    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41883a4c-ca74-49d0-a33e-0d4bb5e56e94" containerName="main"
Sep 20 01:10:48.191808 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.191667    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="41883a4c-ca74-49d0-a33e-0d4bb5e56e94" containerName="main"
Sep 20 01:10:48.191808 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.191744    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="41883a4c-ca74-49d0-a33e-0d4bb5e56e94" containerName="main"
Sep 20 01:10:48.196308 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.196288    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.200056 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.200033    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"openshift-service-ca.crt\""
Sep 20 01:10:48.200172 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.200059    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"kube-root-ca.crt\""
Sep 20 01:10:48.200172 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.200043    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"auth-test-model-4c93ee-kserve-self-signed-certs\""
Sep 20 01:10:48.200172 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.200102    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"default-dockercfg-rgm4h\""
Sep 20 01:10:48.204170 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.204145    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"]
Sep 20 01:10:48.213840 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.213819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:10:48.343369 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.343333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-model-cache\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.343508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.343374    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8gg6\" (UniqueName: \"kubernetes.io/projected/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-kube-api-access-j8gg6\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.343508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.343403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tmp-dir\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.343508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.343451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tls-certs\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.343508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.343487    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-home\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.343644 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.343587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-dshm\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.444972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.444914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-dshm\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.444972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.444945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-model-cache\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.444972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.444966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8gg6\" (UniqueName: \"kubernetes.io/projected/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-kube-api-access-j8gg6\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.445177 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.445000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tmp-dir\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.445177 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.445027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tls-certs\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.445177 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.445072    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-home\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.445351 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.445314    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-model-cache\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.445439 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.445421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-home\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.445500 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.445469    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tmp-dir\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.447213 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.447181    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-dshm\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.447481 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.447465    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tls-certs\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.454158 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.454138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8gg6\" (UniqueName: \"kubernetes.io/projected/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-kube-api-access-j8gg6\") pod \"auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.506521 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.506498    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:48.782463 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:48.782437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"]
Sep 20 01:10:48.784387 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:10:48.784360    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc22209c5_4bed_42cd_bb2d_3b3c51ca9330.slice/crio-17685e7cf23f7f3561caa767b9df69549fd6e47560dc9137bc83484d11fa2395 WatchSource:0}: Error finding container 17685e7cf23f7f3561caa767b9df69549fd6e47560dc9137bc83484d11fa2395: Status 404 returned error can't find the container with id 17685e7cf23f7f3561caa767b9df69549fd6e47560dc9137bc83484d11fa2395
Sep 20 01:10:49.236266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:49.236178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p" event={"ID":"c22209c5-4bed-42cd-bb2d-3b3c51ca9330","Type":"ContainerStarted","Data":"32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1"}
Sep 20 01:10:49.236266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:49.236235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p" event={"ID":"c22209c5-4bed-42cd-bb2d-3b3c51ca9330","Type":"ContainerStarted","Data":"17685e7cf23f7f3561caa767b9df69549fd6e47560dc9137bc83484d11fa2395"}
Sep 20 01:10:49.253322 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:49.253274    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p" podStartSLOduration=1.253259501 podStartE2EDuration="1.253259501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:10:49.251161942 +0000 UTC m=+1396.244437475" watchObservedRunningTime="2026-09-20 01:10:49.253259501 +0000 UTC m=+1396.246535086"
Sep 20 01:10:51.405732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:51.405693    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:10:58.507354 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:58.507312    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:58.507852 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:58.507379    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:58.519969 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:58.519940    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:10:59.298537 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:10:59.298510    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:11:05.944150 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:05.944101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:06.962219 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:06.962157    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:12.389900 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:12.389858    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:12.491027 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:12.490984    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:12.647659 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:12.647572    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:13.946108 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:13.946077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:14.045454 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:14.045423    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:14.145155 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:14.145119    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:14.746263 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:14.746228    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:14.874246 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:14.874184    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:14.969404 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:14.969366    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:16.202789 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:16.202755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:17.899265 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:17.899230    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:11:20.828557 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:20.828524    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:21.635530 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:21.635498    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:21.985987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:21.985898    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:22.088980 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:22.088947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:22.664526 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:22.664487    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:28.299783 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:28.299696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:28.354847 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:28.354820    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:28.430434 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:28.430344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:28.528941 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:28.528917    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:39.026439 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:39.026404    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:39.245317 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:39.245277    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:51.801774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:51.801724    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:11:52.801158 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:11:52.801118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:12:00.198738 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:00.198696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:05.760077 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:05.760043    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:05.860860 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:05.860828    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:06.099484 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:06.099410    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:06.399370 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:06.399283    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:06.765587 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:06.765551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:08.752260 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:08.752219    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:09.421374 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:09.421335    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:09.518834 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:09.518806    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:10.353910 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:10.353879    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:11.208569 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:11.208515    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:12.260668 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:12.260625    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:13.002305 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:13.002268    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:13.697448 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:13.697417    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:14.553541 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:14.553492    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:14.654622 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:14.654590    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:15.002536 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.002500    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:15.102290 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.102258    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:15.292081 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.292003    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"]
Sep 20 01:12:15.295610 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.295593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.298013 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.297993    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e2e8bc\"/\"embedding-w0-e2e8bc-kserve-self-signed-certs\""
Sep 20 01:12:15.307170 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.307147    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"]
Sep 20 01:12:15.308080 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.308056    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:15.436822 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.436798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tls-certs\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.436923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.436827    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-home\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.436923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.436853    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tmp-dir\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.436923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.436909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-model-cache\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.437027 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.436956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wjbv\" (UniqueName: \"kubernetes.io/projected/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-kube-api-access-8wjbv\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.437027 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.436995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-dshm\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538116 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tmp-dir\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538241 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538125    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-model-cache\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538241 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wjbv\" (UniqueName: \"kubernetes.io/projected/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-kube-api-access-8wjbv\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538330 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-dshm\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538330 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tls-certs\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538436 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-home\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538555 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tmp-dir\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538630 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-model-cache\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.538687 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.538677    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-home\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.540684 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.540660    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-dshm\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.540979 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.540959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tls-certs\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.545869 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.545816    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wjbv\" (UniqueName: \"kubernetes.io/projected/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-kube-api-access-8wjbv\") pod \"embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") " pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.604648 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.604624    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:15.685765 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.685736    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:15.879478 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:15.879455    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"]
Sep 20 01:12:15.881491 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:12:15.881463    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod654fa3b0_bf5d_4489_9529_e1a0b5b7eae9.slice/crio-0b8f83fe91d8e81a2c0151ffadfc20fe1276de90245c932a1633b0d457b619d5 WatchSource:0}: Error finding container 0b8f83fe91d8e81a2c0151ffadfc20fe1276de90245c932a1633b0d457b619d5: Status 404 returned error can't find the container with id 0b8f83fe91d8e81a2c0151ffadfc20fe1276de90245c932a1633b0d457b619d5
Sep 20 01:12:16.698121 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:16.698086    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn" event={"ID":"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9","Type":"ContainerStarted","Data":"8442d4b51438a12961d940cf326d216e1bbb631b021b1746e8848f5e4b3b3b6f"}
Sep 20 01:12:16.698551 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:16.698130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn" event={"ID":"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9","Type":"ContainerStarted","Data":"0b8f83fe91d8e81a2c0151ffadfc20fe1276de90245c932a1633b0d457b619d5"}
Sep 20 01:12:16.716994 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:16.716944    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn" podStartSLOduration=1.71693041 podStartE2EDuration="1.71693041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:16.716133363 +0000 UTC m=+1483.709408899" watchObservedRunningTime="2026-09-20 01:12:16.71693041 +0000 UTC m=+1483.710205943"
Sep 20 01:12:25.605576 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:25.605541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:25.605969 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:25.605597    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:25.617784 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:25.617760    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:25.763775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:25.763753    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:12:26.038766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:26.038734    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:33.664285 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:33.664258    2571 scope.go:117] "RemoveContainer" containerID="12d7514804df0a4a86585e054ff5b58eec0a239ecb38a510c060d70b62a0ef3e"
Sep 20 01:12:35.412458 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:35.412409    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:36.837313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:36.837251    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:37.518244 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:37.518207    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:37.599714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:37.599681    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:12:38.346272 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:38.346237    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:39.109957 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:39.109922    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:39.523166 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:39.523130    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:39.838216 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:39.838115    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:39.978424 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:39.978379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:40.262083 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.262050    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"]
Sep 20 01:12:40.266085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.266065    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.268860 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.268841    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bc4088-openshift-default-dockercfg-sfk5r\""
Sep 20 01:12:40.277365 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.277343    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"]
Sep 20 01:12:40.281112 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.281086    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:40.360538 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7261133a-68b3-44e8-a089-066ba00c026e-istiod-ca-cert\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360623    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7261133a-68b3-44e8-a089-066ba00c026e-istio-podinfo\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-credential-socket\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360813 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-data\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360813 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-envoy\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360813 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360788    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-certs\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360818    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdt4t\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-kube-api-access-xdt4t\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-istio-token\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.360972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.360934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-socket\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462257 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-socket\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462432 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7261133a-68b3-44e8-a089-066ba00c026e-istiod-ca-cert\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462432 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7261133a-68b3-44e8-a089-066ba00c026e-istio-podinfo\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462432 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-credential-socket\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462432 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-data\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462452    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-envoy\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-certs\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdt4t\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-kube-api-access-xdt4t\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462817 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-istio-token\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462871 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462807    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-credential-socket\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.462871 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.462807    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-data\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.463152 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.463127    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-certs\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.463286 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.463167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-socket\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.463353 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.463325    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7261133a-68b3-44e8-a089-066ba00c026e-istiod-ca-cert\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.465356 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.465331    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-envoy\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.465450 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.465413    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7261133a-68b3-44e8-a089-066ba00c026e-istio-podinfo\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.470525 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.470499    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-istio-token\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.470900 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.470880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdt4t\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-kube-api-access-xdt4t\") pod \"e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") " pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.577525 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.577478    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:40.673011 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.672978    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:40.854359 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.854318    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"]
Sep 20 01:12:40.855167 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:12:40.855140    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7261133a_68b3_44e8_a089_066ba00c026e.slice/crio-a5eea205d1060492e5efee93314ccd9c25ce51606a18b762a5f60d225427658a WatchSource:0}: Error finding container a5eea205d1060492e5efee93314ccd9c25ce51606a18b762a5f60d225427658a: Status 404 returned error can't find the container with id a5eea205d1060492e5efee93314ccd9c25ce51606a18b762a5f60d225427658a
Sep 20 01:12:40.857795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.857758    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:12:40.857885 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.857836    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:12:40.857926 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.857884    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:12:40.868363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:40.868337    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:41.641041 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:41.641002    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:41.840851 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:41.840813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" event={"ID":"7261133a-68b3-44e8-a089-066ba00c026e","Type":"ContainerStarted","Data":"8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee"}
Sep 20 01:12:41.841050 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:41.840873    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" event={"ID":"7261133a-68b3-44e8-a089-066ba00c026e","Type":"ContainerStarted","Data":"a5eea205d1060492e5efee93314ccd9c25ce51606a18b762a5f60d225427658a"}
Sep 20 01:12:41.860843 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:41.860788    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" podStartSLOduration=1.86077593 podStartE2EDuration="1.86077593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:41.859375076 +0000 UTC m=+1508.852650611" watchObservedRunningTime="2026-09-20 01:12:41.86077593 +0000 UTC m=+1508.854051464"
Sep 20 01:12:42.343135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:42.343095    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:42.578493 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:42.578461    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:42.583911 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:42.583886    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:42.846271 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:42.846245    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:42.847105 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:42.847085    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:12:43.407395 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:43.407362    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:43.810415 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:43.810380    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:43.907632 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:43.907565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:44.189580 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:44.189487    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:45.045173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:45.045115    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:45.748445 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:45.748404    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:46.434418 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:46.434373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:47.210887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:47.210846    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:47.862507 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:47.862471    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:48.184874 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:48.184773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:48.285328 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:48.285290    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:48.581618 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:48.581590    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:48.681747 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:48.681720    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:49.394095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:49.394061    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:49.495257 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:49.495222    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:49.594828 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:49.594798    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:49.881487 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:49.881447    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:12:49.997596 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:12:49.997564    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:11.339340 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:11.339307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:12.424915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:12.424882    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:13.127361 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:13.127319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:13.819062 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:13.819030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:13.920470 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:13.920439    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:14.720991 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:14.720958    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:15.405961 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:15.405924    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:16.222565 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.222516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:16.837914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.837858    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"]
Sep 20 01:13:16.841631 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.841611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"
Sep 20 01:13:16.844126 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.844088    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:13:16.844370 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.844100    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:13:16.848536 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.848498    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"]
Sep 20 01:13:16.954451 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.954421    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:16.990012 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:16.989981    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/522fbf1b-8bcd-4e3a-a1dd-eabc0886406c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6\" (UID: \"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"
Sep 20 01:13:17.090795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:17.090725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/522fbf1b-8bcd-4e3a-a1dd-eabc0886406c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6\" (UID: \"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"
Sep 20 01:13:17.091389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:17.091372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/522fbf1b-8bcd-4e3a-a1dd-eabc0886406c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6\" (UID: \"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"
Sep 20 01:13:17.156444 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:17.156422    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"
Sep 20 01:13:17.429226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:17.429127    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"]
Sep 20 01:13:17.432286 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:13:17.432251    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522fbf1b_8bcd_4e3a_a1dd_eabc0886406c.slice/crio-b1d41157b1dfd6fe6f3b8e1a3d45f56efbc20992dd10b07723cfe9f921f81104 WatchSource:0}: Error finding container b1d41157b1dfd6fe6f3b8e1a3d45f56efbc20992dd10b07723cfe9f921f81104: Status 404 returned error can't find the container with id b1d41157b1dfd6fe6f3b8e1a3d45f56efbc20992dd10b07723cfe9f921f81104
Sep 20 01:13:17.717540 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:17.717464    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:18.034183 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:18.034144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6" event={"ID":"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c","Type":"ContainerStarted","Data":"0e0b8b2c60f6464e360ee9ac99eb32db3dfc86236bb41a8b5f228918bb63a9b8"}
Sep 20 01:13:18.034580 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:18.034273    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6" event={"ID":"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c","Type":"ContainerStarted","Data":"b1d41157b1dfd6fe6f3b8e1a3d45f56efbc20992dd10b07723cfe9f921f81104"}
Sep 20 01:13:18.050646 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:18.050592    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6" podStartSLOduration=2.050576045 podStartE2EDuration="2.050576045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:13:18.050280604 +0000 UTC m=+1545.043556139" watchObservedRunningTime="2026-09-20 01:13:18.050576045 +0000 UTC m=+1545.043851581"
Sep 20 01:13:18.529149 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:18.529124    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:19.041293 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:19.041261    2571 generic.go:356] "Generic (PLEG): container finished" podID="522fbf1b-8bcd-4e3a-a1dd-eabc0886406c" containerID="0e0b8b2c60f6464e360ee9ac99eb32db3dfc86236bb41a8b5f228918bb63a9b8" exitCode=0
Sep 20 01:13:19.041645 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:19.041350    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6" event={"ID":"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c","Type":"ContainerDied","Data":"0e0b8b2c60f6464e360ee9ac99eb32db3dfc86236bb41a8b5f228918bb63a9b8"}
Sep 20 01:13:19.842610 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:19.842576    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:19.939694 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:19.939663    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:20.182951 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:20.182932    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"
Sep 20 01:13:20.215479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:20.215454    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/522fbf1b-8bcd-4e3a-a1dd-eabc0886406c-maas-api-service-ca\") pod \"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c\" (UID: \"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c\") "
Sep 20 01:13:20.215850 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:20.215831    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/522fbf1b-8bcd-4e3a-a1dd-eabc0886406c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "522fbf1b-8bcd-4e3a-a1dd-eabc0886406c" (UID: "522fbf1b-8bcd-4e3a-a1dd-eabc0886406c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:20.316479 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:20.316457    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/522fbf1b-8bcd-4e3a-a1dd-eabc0886406c-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:13:20.836460 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:20.836405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:21.053931 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:21.053904    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"
Sep 20 01:13:21.054095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:21.053904    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6" event={"ID":"522fbf1b-8bcd-4e3a-a1dd-eabc0886406c","Type":"ContainerDied","Data":"b1d41157b1dfd6fe6f3b8e1a3d45f56efbc20992dd10b07723cfe9f921f81104"}
Sep 20 01:13:21.054095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:21.054034    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1d41157b1dfd6fe6f3b8e1a3d45f56efbc20992dd10b07723cfe9f921f81104"
Sep 20 01:13:21.521875 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:21.521842    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:22.328643 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:22.328601    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:23.023988 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:23.023951    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:23.731838 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:23.731804    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:25.796865 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:25.796827    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:13:27.139066 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:27.139032    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:32.737006 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:32.736967    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:32.795790 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:32.795738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:32.862806 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:32.862759    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:32.958621 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:32.958585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:32.972210 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:32.972168    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"]
Sep 20 01:13:32.974158 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:32.974136    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a5f8d9-j84c6"]
Sep 20 01:13:33.058780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:33.058739    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:33.305249 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:33.305187    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:33.406477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:33.406386    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:33.515733 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:33.515698    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522fbf1b-8bcd-4e3a-a1dd-eabc0886406c" path="/var/lib/kubelet/pods/522fbf1b-8bcd-4e3a-a1dd-eabc0886406c/volumes"
Sep 20 01:13:33.683467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:33.683399    2571 scope.go:117] "RemoveContainer" containerID="6b103a2c7c1b3662aa63f94452f99ea7b1d46ef65490018338153b225ac539e0"
Sep 20 01:13:34.135134 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:34.135099    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:34.834863 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:34.834824    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:35.714073 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:35.714038    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:36.441237 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:36.441188    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:37.124386 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:37.124359    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:37.146794 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:37.146761    2571 generic.go:356] "Generic (PLEG): container finished" podID="7261133a-68b3-44e8-a089-066ba00c026e" containerID="8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee" exitCode=0
Sep 20 01:13:37.146916 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:37.146837    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" event={"ID":"7261133a-68b3-44e8-a089-066ba00c026e","Type":"ContainerDied","Data":"8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee"}
Sep 20 01:13:37.147289 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:37.147271    2571 scope.go:117] "RemoveContainer" containerID="8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee"
Sep 20 01:13:37.148482 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:37.148449    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:13:37.148558 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:37.148521    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:13:37.148558 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:37.148555    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:13:38.022723 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:38.022692    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:38.158628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:38.158590    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" event={"ID":"7261133a-68b3-44e8-a089-066ba00c026e","Type":"ContainerStarted","Data":"33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0"}
Sep 20 01:13:38.578612 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:38.578575    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:13:38.579885 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:38.579856    2571 patch_prober.go:28] interesting pod/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 20 01:13:38.580017 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:38.579915    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 20 01:13:38.835634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:38.835535    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:39.317758 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:39.317723    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:39.420031 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:39.420000    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:39.561217 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:39.561145    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:39.578817 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:39.578736    2571 patch_prober.go:28] interesting pod/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 20 01:13:39.578955 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:39.578814    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 20 01:13:39.653757 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:39.653676    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:40.424412 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:40.424378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:40.578714 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:40.578680    2571 patch_prober.go:28] interesting pod/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 20 01:13:40.578891 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:40.578743    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 20 01:13:41.352905 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:41.352863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:41.578042 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:41.578012    2571 patch_prober.go:28] interesting pod/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 20 01:13:41.578433 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:41.578070    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 20 01:13:42.021298 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:42.021266    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:42.577993 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:42.577959    2571 patch_prober.go:28] interesting pod/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 20 01:13:42.578159 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:42.578031    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 20 01:13:42.784319 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:42.784286    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:42.846782 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:42.846702    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:13:43.545786 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:43.545750    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:43.582606 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:43.582579    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:13:43.583578 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:43.583560    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:13:44.231572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:44.231536    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:44.584213 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:44.584134    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:44.922480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:44.922399    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:45.624824 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:45.624788    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:50.029593 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:50.029553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:51.082732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:51.082683    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:51.505244 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:51.505184    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:52.112363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.112318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:52.229889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.229861    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"]
Sep 20 01:13:52.230247 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.230235    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522fbf1b-8bcd-4e3a-a1dd-eabc0886406c" containerName="revoke-keys"
Sep 20 01:13:52.230301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.230249    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="522fbf1b-8bcd-4e3a-a1dd-eabc0886406c" containerName="revoke-keys"
Sep 20 01:13:52.230338 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.230329    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="522fbf1b-8bcd-4e3a-a1dd-eabc0886406c" containerName="revoke-keys"
Sep 20 01:13:52.232295 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.232278    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"
Sep 20 01:13:52.234634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.234607    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:13:52.234753 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.234667    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:13:52.239491 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.239469    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"]
Sep 20 01:13:52.293422 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.293398    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:52.337177 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.337154    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc997049-966e-4cbd-9ed8-b7243002b1c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk\" (UID: \"cc997049-966e-4cbd-9ed8-b7243002b1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"
Sep 20 01:13:52.438517 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.438444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc997049-966e-4cbd-9ed8-b7243002b1c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk\" (UID: \"cc997049-966e-4cbd-9ed8-b7243002b1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"
Sep 20 01:13:52.439062 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.439031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc997049-966e-4cbd-9ed8-b7243002b1c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk\" (UID: \"cc997049-966e-4cbd-9ed8-b7243002b1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"
Sep 20 01:13:52.544141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.544114    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"
Sep 20 01:13:52.812027 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:52.812002    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"]
Sep 20 01:13:52.813625 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:13:52.813602    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc997049_966e_4cbd_9ed8_b7243002b1c6.slice/crio-0c913a7f430e779421ab3343d8caa1d0d351cee521bd0a9590e9cb296b35de77 WatchSource:0}: Error finding container 0c913a7f430e779421ab3343d8caa1d0d351cee521bd0a9590e9cb296b35de77: Status 404 returned error can't find the container with id 0c913a7f430e779421ab3343d8caa1d0d351cee521bd0a9590e9cb296b35de77
Sep 20 01:13:53.244912 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:53.244884    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk" event={"ID":"cc997049-966e-4cbd-9ed8-b7243002b1c6","Type":"ContainerStarted","Data":"cae7d8a0e4af64767ed6b39dd012cbdd5310d202f03cba08f51a4d928d186c21"}
Sep 20 01:13:53.245324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:53.244937    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk" event={"ID":"cc997049-966e-4cbd-9ed8-b7243002b1c6","Type":"ContainerStarted","Data":"0c913a7f430e779421ab3343d8caa1d0d351cee521bd0a9590e9cb296b35de77"}
Sep 20 01:13:53.260707 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:53.260666    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk" podStartSLOduration=1.260651511 podStartE2EDuration="1.260651511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:13:53.25823071 +0000 UTC m=+1580.251506243" watchObservedRunningTime="2026-09-20 01:13:53.260651511 +0000 UTC m=+1580.253927043"
Sep 20 01:13:53.311522 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:53.311495    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:53.924016 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:53.923943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:53.990661 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:53.990625    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:54.045550 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:54.045513    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:54.146105 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:54.146069    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:54.197995 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:54.197911    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:54.251772 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:54.251739    2571 generic.go:356] "Generic (PLEG): container finished" podID="cc997049-966e-4cbd-9ed8-b7243002b1c6" containerID="cae7d8a0e4af64767ed6b39dd012cbdd5310d202f03cba08f51a4d928d186c21" exitCode=0
Sep 20 01:13:54.252161 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:54.251835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk" event={"ID":"cc997049-966e-4cbd-9ed8-b7243002b1c6","Type":"ContainerDied","Data":"cae7d8a0e4af64767ed6b39dd012cbdd5310d202f03cba08f51a4d928d186c21"}
Sep 20 01:13:54.389989 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:54.389949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:54.664614 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:54.664584    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:55.249103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:55.249068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:55.400710 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:55.400689    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"
Sep 20 01:13:55.465899 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:55.465864    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc997049-966e-4cbd-9ed8-b7243002b1c6-maas-api-service-ca\") pod \"cc997049-966e-4cbd-9ed8-b7243002b1c6\" (UID: \"cc997049-966e-4cbd-9ed8-b7243002b1c6\") "
Sep 20 01:13:55.466231 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:55.466181    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc997049-966e-4cbd-9ed8-b7243002b1c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc997049-966e-4cbd-9ed8-b7243002b1c6" (UID: "cc997049-966e-4cbd-9ed8-b7243002b1c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:55.566975 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:55.566951    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc997049-966e-4cbd-9ed8-b7243002b1c6-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:13:56.039281 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.039242    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:56.148386 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.148348    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"]
Sep 20 01:13:56.167015 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.166987    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"]
Sep 20 01:13:56.264148 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.264123    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"
Sep 20 01:13:56.264324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.264177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk" event={"ID":"cc997049-966e-4cbd-9ed8-b7243002b1c6","Type":"ContainerDied","Data":"0c913a7f430e779421ab3343d8caa1d0d351cee521bd0a9590e9cb296b35de77"}
Sep 20 01:13:56.264324 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.264249    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c913a7f430e779421ab3343d8caa1d0d351cee521bd0a9590e9cb296b35de77"
Sep 20 01:13:56.294744 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.294673    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:56.718477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:56.718408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:57.108878 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:57.108847    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"]
Sep 20 01:13:57.113773 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:57.113745    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"]
Sep 20 01:13:57.122588 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:57.122562    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"]
Sep 20 01:13:57.174821 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:57.174792    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:57.543995 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:57.543970    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:58.254294 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:58.254259    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:13:59.291272 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:13:59.291234    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:00.018463 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:00.018414    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:00.575866 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:00.575835    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:00.675929 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:00.675899    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:00.827557 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:00.827485    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"]
Sep 20 01:14:00.827791 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:00.827737    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy" containerID="cri-o://33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0" gracePeriod=30
Sep 20 01:14:00.850376 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:00.850350    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:01.695271 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:01.695245    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:02.500472 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:02.500437    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:03.439209 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:03.439163    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:04.132303 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:04.132269    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:04.927846 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:04.927816    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:05.643151 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:05.643116    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:06.086141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.086116    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:14:06.155379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155348    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-envoy\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155400    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-data\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155433    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-socket\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155448    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7261133a-68b3-44e8-a089-066ba00c026e-istio-podinfo\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155478    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7261133a-68b3-44e8-a089-066ba00c026e-istiod-ca-cert\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155492    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-istio-token\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155516    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdt4t\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-kube-api-access-xdt4t\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155570    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-credential-socket\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155634    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-certs\") pod \"7261133a-68b3-44e8-a089-066ba00c026e\" (UID: \"7261133a-68b3-44e8-a089-066ba00c026e\") "
Sep 20 01:14:06.155935 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.155764    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:06.156101 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.156004    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7261133a-68b3-44e8-a089-066ba00c026e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:06.156101 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.156013    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.156382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.156120    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:06.156382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.156225    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:06.156625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.156600    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:06.157730 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.157702    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:06.157818 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.157744    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:06.157818 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.157800    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7261133a-68b3-44e8-a089-066ba00c026e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:14:06.157891 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.157808    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-kube-api-access-xdt4t" (OuterVolumeSpecName: "kube-api-access-xdt4t") pod "7261133a-68b3-44e8-a089-066ba00c026e" (UID: "7261133a-68b3-44e8-a089-066ba00c026e"). InnerVolumeSpecName "kube-api-access-xdt4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:06.257693 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257669    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.257693 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257692    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7261133a-68b3-44e8-a089-066ba00c026e-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.257827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257702    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7261133a-68b3-44e8-a089-066ba00c026e-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.257827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257710    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.257827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257718    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdt4t\" (UniqueName: \"kubernetes.io/projected/7261133a-68b3-44e8-a089-066ba00c026e-kube-api-access-xdt4t\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.257827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257728    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.257827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257737    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.257827 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.257745    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7261133a-68b3-44e8-a089-066ba00c026e-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:06.322624 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.322592    2571 generic.go:356] "Generic (PLEG): container finished" podID="7261133a-68b3-44e8-a089-066ba00c026e" containerID="33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0" exitCode=0
Sep 20 01:14:06.322734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.322654    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"
Sep 20 01:14:06.322734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.322669    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" event={"ID":"7261133a-68b3-44e8-a089-066ba00c026e","Type":"ContainerDied","Data":"33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0"}
Sep 20 01:14:06.322848 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.322751    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b" event={"ID":"7261133a-68b3-44e8-a089-066ba00c026e","Type":"ContainerDied","Data":"a5eea205d1060492e5efee93314ccd9c25ce51606a18b762a5f60d225427658a"}
Sep 20 01:14:06.322848 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.322785    2571 scope.go:117] "RemoveContainer" containerID="33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0"
Sep 20 01:14:06.332812 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.332793    2571 scope.go:117] "RemoveContainer" containerID="8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee"
Sep 20 01:14:06.340533 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.340518    2571 scope.go:117] "RemoveContainer" containerID="33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0"
Sep 20 01:14:06.340774 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:14:06.340757    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0\": container with ID starting with 33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0 not found: ID does not exist" containerID="33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0"
Sep 20 01:14:06.340820 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.340781    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0"} err="failed to get container status \"33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0\": rpc error: code = NotFound desc = could not find container \"33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0\": container with ID starting with 33f45b8739a02743ec65b65246721c8915c758f719a02163314ec83cfef936d0 not found: ID does not exist"
Sep 20 01:14:06.340820 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.340799    2571 scope.go:117] "RemoveContainer" containerID="8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee"
Sep 20 01:14:06.341050 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:14:06.341033    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee\": container with ID starting with 8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee not found: ID does not exist" containerID="8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee"
Sep 20 01:14:06.341087 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.341057    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee"} err="failed to get container status \"8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee\": rpc error: code = NotFound desc = could not find container \"8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee\": container with ID starting with 8b95d35a76d3723c0b9db37436079d2c4a9504bc1d51a5a2adf7f3d4eec4e9ee not found: ID does not exist"
Sep 20 01:14:06.345435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.345413    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"]
Sep 20 01:14:06.349208 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:06.349176    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b"]
Sep 20 01:14:07.356523 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.356489    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"]
Sep 20 01:14:07.356983 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.356718    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p" podUID="5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" containerName="payload-pre-processing" containerID="cri-o://8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330" gracePeriod=30
Sep 20 01:14:07.362060 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.362029    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:07.456147 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.456115    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:07.510477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.510448    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7261133a-68b3-44e8-a089-066ba00c026e" path="/var/lib/kubelet/pods/7261133a-68b3-44e8-a089-066ba00c026e/volumes"
Sep 20 01:14:07.516143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.516118    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:07.581522 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.581491    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:07.616259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.616070    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:14:07.670245 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.670175    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-plugins-config-volume\") pod \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") "
Sep 20 01:14:07.670416 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.670286    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw58m\" (UniqueName: \"kubernetes.io/projected/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-kube-api-access-jw58m\") pod \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\" (UID: \"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a\") "
Sep 20 01:14:07.670591 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.670564    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" (UID: "5e858225-8d59-44ce-83a7-dc1d9a7f4b9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:07.670705 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.670680    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:07.673134 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.673114    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-kube-api-access-jw58m" (OuterVolumeSpecName: "kube-api-access-jw58m") pod "5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" (UID: "5e858225-8d59-44ce-83a7-dc1d9a7f4b9a"). InnerVolumeSpecName "kube-api-access-jw58m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:07.771888 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.771864    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw58m\" (UniqueName: \"kubernetes.io/projected/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a-kube-api-access-jw58m\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:07.900440 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:07.900368    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:08.004352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.004323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:08.336627 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.336595    2571 generic.go:356] "Generic (PLEG): container finished" podID="5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" containerID="8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330" exitCode=0
Sep 20 01:14:08.336788 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.336635    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"
Sep 20 01:14:08.336788 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.336652    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p" event={"ID":"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a","Type":"ContainerDied","Data":"8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330"}
Sep 20 01:14:08.336788 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.336701    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p" event={"ID":"5e858225-8d59-44ce-83a7-dc1d9a7f4b9a","Type":"ContainerDied","Data":"6a63f5b742187c8e270fd37a03531c13b5e51a35f693f02534251ed1304e2236"}
Sep 20 01:14:08.336788 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.336725    2571 scope.go:117] "RemoveContainer" containerID="8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330"
Sep 20 01:14:08.345558 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.345540    2571 scope.go:117] "RemoveContainer" containerID="8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330"
Sep 20 01:14:08.345825 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:14:08.345807    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330\": container with ID starting with 8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330 not found: ID does not exist" containerID="8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330"
Sep 20 01:14:08.345872 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.345831    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330"} err="failed to get container status \"8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330\": rpc error: code = NotFound desc = could not find container \"8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330\": container with ID starting with 8c4c48992f4a0bee66a3fd31b0bd8e680afe5d2bad328be88caad740a9af9330 not found: ID does not exist"
Sep 20 01:14:08.356952 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.356930    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"]
Sep 20 01:14:08.360970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.360948    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p"]
Sep 20 01:14:08.575778 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.575729    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:08.642485 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.642401    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:08.700386 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.700359    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:08.803376 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.803340    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:08.804366 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.804344    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"]
Sep 20 01:14:08.807471 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.807448    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e2e8bc-wclbk"]
Sep 20 01:14:08.922161 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.922092    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:08.980537 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:08.980497    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:09.188095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:09.188007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:09.508614 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:09.508583    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" path="/var/lib/kubelet/pods/5e858225-8d59-44ce-83a7-dc1d9a7f4b9a/volumes"
Sep 20 01:14:09.508975 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:09.508908    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc997049-966e-4cbd-9ed8-b7243002b1c6" path="/var/lib/kubelet/pods/cc997049-966e-4cbd-9ed8-b7243002b1c6/volumes"
Sep 20 01:14:09.736628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:09.736567    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:10.204439 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:10.204403    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:14:10.552536 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:10.552499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:11.168016 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.167965    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4" podUID="dfbeef66-98de-45de-83f0-95c24fd64594" containerName="main" containerID="cri-o://9d80caef94e09de38ac318505d60a9b03d6532f81153e2c26db3bc9a3ea162fd" gracePeriod=45
Sep 20 01:14:11.185920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.185884    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7" podUID="8a8a3d3e-6ee1-4785-879e-8ceff0357076" containerName="main" containerID="cri-o://80ec7d72e636788ea39df0ecd6d43b2d213ac39df24716f9ade5654b17af2fd2" gracePeriod=45
Sep 20 01:14:11.331050 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.331000    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:11.367352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.367324    2571 generic.go:356] "Generic (PLEG): container finished" podID="8a8a3d3e-6ee1-4785-879e-8ceff0357076" containerID="80ec7d72e636788ea39df0ecd6d43b2d213ac39df24716f9ade5654b17af2fd2" exitCode=0
Sep 20 01:14:11.367504 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.367399    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7" event={"ID":"8a8a3d3e-6ee1-4785-879e-8ceff0357076","Type":"ContainerDied","Data":"80ec7d72e636788ea39df0ecd6d43b2d213ac39df24716f9ade5654b17af2fd2"}
Sep 20 01:14:11.369107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.369086    2571 generic.go:356] "Generic (PLEG): container finished" podID="dfbeef66-98de-45de-83f0-95c24fd64594" containerID="9d80caef94e09de38ac318505d60a9b03d6532f81153e2c26db3bc9a3ea162fd" exitCode=0
Sep 20 01:14:11.369240 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.369132    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4" event={"ID":"dfbeef66-98de-45de-83f0-95c24fd64594","Type":"ContainerDied","Data":"9d80caef94e09de38ac318505d60a9b03d6532f81153e2c26db3bc9a3ea162fd"}
Sep 20 01:14:11.461379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.461343    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:14:11.464848 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.464828    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:14:11.504984 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.504960    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-model-cache\") pod \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") "
Sep 20 01:14:11.505156 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505002    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-dshm\") pod \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") "
Sep 20 01:14:11.505156 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505033    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tls-certs\") pod \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") "
Sep 20 01:14:11.505156 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505072    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-home\") pod \"dfbeef66-98de-45de-83f0-95c24fd64594\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") "
Sep 20 01:14:11.505156 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505119    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tmp-dir\") pod \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") "
Sep 20 01:14:11.505490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505304    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a8a3d3e-6ee1-4785-879e-8ceff0357076" (UID: "8a8a3d3e-6ee1-4785-879e-8ceff0357076"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.505490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505390    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzscx\" (UniqueName: \"kubernetes.io/projected/dfbeef66-98de-45de-83f0-95c24fd64594-kube-api-access-mzscx\") pod \"dfbeef66-98de-45de-83f0-95c24fd64594\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") "
Sep 20 01:14:11.505490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505445    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-tmp-dir\") pod \"dfbeef66-98de-45de-83f0-95c24fd64594\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") "
Sep 20 01:14:11.505490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505480    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s5mg\" (UniqueName: \"kubernetes.io/projected/8a8a3d3e-6ee1-4785-879e-8ceff0357076-kube-api-access-7s5mg\") pod \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") "
Sep 20 01:14:11.505787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505509    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-dshm\") pod \"dfbeef66-98de-45de-83f0-95c24fd64594\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") "
Sep 20 01:14:11.505787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505567    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-model-cache\") pod \"dfbeef66-98de-45de-83f0-95c24fd64594\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") "
Sep 20 01:14:11.505787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505632    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-home" (OuterVolumeSpecName: "home") pod "dfbeef66-98de-45de-83f0-95c24fd64594" (UID: "dfbeef66-98de-45de-83f0-95c24fd64594"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.505787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505646    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-home\") pod \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\" (UID: \"8a8a3d3e-6ee1-4785-879e-8ceff0357076\") "
Sep 20 01:14:11.505787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505732    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dfbeef66-98de-45de-83f0-95c24fd64594" (UID: "dfbeef66-98de-45de-83f0-95c24fd64594"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.505787 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505748    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbeef66-98de-45de-83f0-95c24fd64594-tls-certs\") pod \"dfbeef66-98de-45de-83f0-95c24fd64594\" (UID: \"dfbeef66-98de-45de-83f0-95c24fd64594\") "
Sep 20 01:14:11.506114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505838    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a8a3d3e-6ee1-4785-879e-8ceff0357076" (UID: "8a8a3d3e-6ee1-4785-879e-8ceff0357076"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.506114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.505855    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-home" (OuterVolumeSpecName: "home") pod "8a8a3d3e-6ee1-4785-879e-8ceff0357076" (UID: "8a8a3d3e-6ee1-4785-879e-8ceff0357076"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.506114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.506055    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-model-cache" (OuterVolumeSpecName: "model-cache") pod "dfbeef66-98de-45de-83f0-95c24fd64594" (UID: "dfbeef66-98de-45de-83f0-95c24fd64594"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.506280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.506155    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.506280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.506173    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.506280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.506187    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.506280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.506213    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.506280 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.506225    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.508419 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.508361    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfbeef66-98de-45de-83f0-95c24fd64594-kube-api-access-mzscx" (OuterVolumeSpecName: "kube-api-access-mzscx") pod "dfbeef66-98de-45de-83f0-95c24fd64594" (UID: "dfbeef66-98de-45de-83f0-95c24fd64594"). InnerVolumeSpecName "kube-api-access-mzscx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:11.508614 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.508593    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-dshm" (OuterVolumeSpecName: "dshm") pod "8a8a3d3e-6ee1-4785-879e-8ceff0357076" (UID: "8a8a3d3e-6ee1-4785-879e-8ceff0357076"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.508872 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.508849    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfbeef66-98de-45de-83f0-95c24fd64594-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dfbeef66-98de-45de-83f0-95c24fd64594" (UID: "dfbeef66-98de-45de-83f0-95c24fd64594"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:11.508945 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.508902    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a8a3d3e-6ee1-4785-879e-8ceff0357076" (UID: "8a8a3d3e-6ee1-4785-879e-8ceff0357076"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:11.508987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.508963    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8a3d3e-6ee1-4785-879e-8ceff0357076-kube-api-access-7s5mg" (OuterVolumeSpecName: "kube-api-access-7s5mg") pod "8a8a3d3e-6ee1-4785-879e-8ceff0357076" (UID: "8a8a3d3e-6ee1-4785-879e-8ceff0357076"). InnerVolumeSpecName "kube-api-access-7s5mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:11.509022 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.508986    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-dshm" (OuterVolumeSpecName: "dshm") pod "dfbeef66-98de-45de-83f0-95c24fd64594" (UID: "dfbeef66-98de-45de-83f0-95c24fd64594"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.606913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.606890    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.606913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.606912    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbeef66-98de-45de-83f0-95c24fd64594-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.607266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.606923    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbeef66-98de-45de-83f0-95c24fd64594-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.607266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.606930    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a8a3d3e-6ee1-4785-879e-8ceff0357076-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.607266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.606937    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8a3d3e-6ee1-4785-879e-8ceff0357076-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.607266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.606945    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzscx\" (UniqueName: \"kubernetes.io/projected/dfbeef66-98de-45de-83f0-95c24fd64594-kube-api-access-mzscx\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.607266 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:11.606954    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s5mg\" (UniqueName: \"kubernetes.io/projected/8a8a3d3e-6ee1-4785-879e-8ceff0357076-kube-api-access-7s5mg\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.129077 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.129032    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn" podUID="654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" containerName="main" containerID="cri-o://8442d4b51438a12961d940cf326d216e1bbb631b021b1746e8848f5e4b3b3b6f" gracePeriod=45
Sep 20 01:14:12.133003 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.132950    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk" podUID="61126d66-731e-4c4e-8330-68633cae6e85" containerName="main" containerID="cri-o://de94148e5a55b723464f3b3e49971ecd867548b34d5b9603e81bb1b6ba211a5f" gracePeriod=45
Sep 20 01:14:12.143729 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.143690    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7" podUID="bc89966b-fc69-4617-993d-3e5f383619bb" containerName="main" containerID="cri-o://682f192c6969c285506cfc8645dbd6074a5974f96177326e9109eb3b702a589f" gracePeriod=45
Sep 20 01:14:12.237625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.237583    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:12.378836 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.378704    2571 generic.go:356] "Generic (PLEG): container finished" podID="654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" containerID="8442d4b51438a12961d940cf326d216e1bbb631b021b1746e8848f5e4b3b3b6f" exitCode=0
Sep 20 01:14:12.378836 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.378746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn" event={"ID":"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9","Type":"ContainerDied","Data":"8442d4b51438a12961d940cf326d216e1bbb631b021b1746e8848f5e4b3b3b6f"}
Sep 20 01:14:12.381014 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.380950    2571 generic.go:356] "Generic (PLEG): container finished" podID="bc89966b-fc69-4617-993d-3e5f383619bb" containerID="682f192c6969c285506cfc8645dbd6074a5974f96177326e9109eb3b702a589f" exitCode=0
Sep 20 01:14:12.381125 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.381026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7" event={"ID":"bc89966b-fc69-4617-993d-3e5f383619bb","Type":"ContainerDied","Data":"682f192c6969c285506cfc8645dbd6074a5974f96177326e9109eb3b702a589f"}
Sep 20 01:14:12.387306 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.387226    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7" event={"ID":"8a8a3d3e-6ee1-4785-879e-8ceff0357076","Type":"ContainerDied","Data":"e7fef1ddfb37c5b6ec3179768a813f17c35a35d4a89c423f34cf6388e84aabca"}
Sep 20 01:14:12.387306 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.387273    2571 scope.go:117] "RemoveContainer" containerID="80ec7d72e636788ea39df0ecd6d43b2d213ac39df24716f9ade5654b17af2fd2"
Sep 20 01:14:12.387306 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.387233    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"
Sep 20 01:14:12.391170 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.391143    2571 generic.go:356] "Generic (PLEG): container finished" podID="61126d66-731e-4c4e-8330-68633cae6e85" containerID="de94148e5a55b723464f3b3e49971ecd867548b34d5b9603e81bb1b6ba211a5f" exitCode=0
Sep 20 01:14:12.391433 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.391230    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk" event={"ID":"61126d66-731e-4c4e-8330-68633cae6e85","Type":"ContainerDied","Data":"de94148e5a55b723464f3b3e49971ecd867548b34d5b9603e81bb1b6ba211a5f"}
Sep 20 01:14:12.393834 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.393269    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4" event={"ID":"dfbeef66-98de-45de-83f0-95c24fd64594","Type":"ContainerDied","Data":"377c6be395c96149fb9720bef03f44aa88b34a00af647c60b94f8a1ea0ef352f"}
Sep 20 01:14:12.393834 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.393338    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"
Sep 20 01:14:12.403071 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.403036    2571 scope.go:117] "RemoveContainer" containerID="9d80caef94e09de38ac318505d60a9b03d6532f81153e2c26db3bc9a3ea162fd"
Sep 20 01:14:12.409671 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.409649    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"]
Sep 20 01:14:12.414123 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.414093    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/simulator-w4-4e301e-kserve-59b6b5c59f-zzpc7"]
Sep 20 01:14:12.428429 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.428408    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"]
Sep 20 01:14:12.434716 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.434694    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-2-w4-4e301e-kserve-7d68d4f74-c98d4"]
Sep 20 01:14:12.451015 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.450991    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:14:12.454482 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.454463    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:14:12.458856 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.458838    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:14:12.515315 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515287    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64dq7\" (UniqueName: \"kubernetes.io/projected/61126d66-731e-4c4e-8330-68633cae6e85-kube-api-access-64dq7\") pod \"61126d66-731e-4c4e-8330-68633cae6e85\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") "
Sep 20 01:14:12.515476 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515325    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-home\") pod \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") "
Sep 20 01:14:12.515476 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515353    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-home\") pod \"bc89966b-fc69-4617-993d-3e5f383619bb\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") "
Sep 20 01:14:12.515582 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515476    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-dshm\") pod \"bc89966b-fc69-4617-993d-3e5f383619bb\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") "
Sep 20 01:14:12.515582 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515532    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61126d66-731e-4c4e-8330-68633cae6e85-tls-certs\") pod \"61126d66-731e-4c4e-8330-68633cae6e85\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") "
Sep 20 01:14:12.515582 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515567    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-model-cache\") pod \"61126d66-731e-4c4e-8330-68633cae6e85\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") "
Sep 20 01:14:12.515734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515592    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tmp-dir\") pod \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") "
Sep 20 01:14:12.515734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515594    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-home" (OuterVolumeSpecName: "home") pod "bc89966b-fc69-4617-993d-3e5f383619bb" (UID: "bc89966b-fc69-4617-993d-3e5f383619bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.515734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515600    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-home" (OuterVolumeSpecName: "home") pod "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" (UID: "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.515734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515627    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tls-certs\") pod \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") "
Sep 20 01:14:12.515734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515694    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wjbv\" (UniqueName: \"kubernetes.io/projected/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-kube-api-access-8wjbv\") pod \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") "
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515741    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc89966b-fc69-4617-993d-3e5f383619bb-tls-certs\") pod \"bc89966b-fc69-4617-993d-3e5f383619bb\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") "
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515764    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-home\") pod \"61126d66-731e-4c4e-8330-68633cae6e85\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") "
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515808    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-model-cache" (OuterVolumeSpecName: "model-cache") pod "61126d66-731e-4c4e-8330-68633cae6e85" (UID: "61126d66-731e-4c4e-8330-68633cae6e85"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515814    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-tmp-dir\") pod \"61126d66-731e-4c4e-8330-68633cae6e85\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") "
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-dshm\") pod \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") "
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515891    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-model-cache\") pod \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\" (UID: \"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9\") "
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515920    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cp8t\" (UniqueName: \"kubernetes.io/projected/bc89966b-fc69-4617-993d-3e5f383619bb-kube-api-access-8cp8t\") pod \"bc89966b-fc69-4617-993d-3e5f383619bb\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") "
Sep 20 01:14:12.515987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.515978    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-dshm\") pod \"61126d66-731e-4c4e-8330-68633cae6e85\" (UID: \"61126d66-731e-4c4e-8330-68633cae6e85\") "
Sep 20 01:14:12.516435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516006    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "61126d66-731e-4c4e-8330-68633cae6e85" (UID: "61126d66-731e-4c4e-8330-68633cae6e85"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.516435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516016    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-tmp-dir\") pod \"bc89966b-fc69-4617-993d-3e5f383619bb\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") "
Sep 20 01:14:12.516435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516055    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-model-cache\") pod \"bc89966b-fc69-4617-993d-3e5f383619bb\" (UID: \"bc89966b-fc69-4617-993d-3e5f383619bb\") "
Sep 20 01:14:12.516584 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516440    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.516584 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516461    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.516584 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516475    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.516584 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516487    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.516789 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.516694    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "bc89966b-fc69-4617-993d-3e5f383619bb" (UID: "bc89966b-fc69-4617-993d-3e5f383619bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.517881 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.517351    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" (UID: "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.517881 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.517564    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-model-cache" (OuterVolumeSpecName: "model-cache") pod "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" (UID: "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.518389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.518145    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61126d66-731e-4c4e-8330-68633cae6e85-kube-api-access-64dq7" (OuterVolumeSpecName: "kube-api-access-64dq7") pod "61126d66-731e-4c4e-8330-68633cae6e85" (UID: "61126d66-731e-4c4e-8330-68633cae6e85"). InnerVolumeSpecName "kube-api-access-64dq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:12.518389 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.518147    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61126d66-731e-4c4e-8330-68633cae6e85-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "61126d66-731e-4c4e-8330-68633cae6e85" (UID: "61126d66-731e-4c4e-8330-68633cae6e85"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:12.518567 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.518407    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-home" (OuterVolumeSpecName: "home") pod "61126d66-731e-4c4e-8330-68633cae6e85" (UID: "61126d66-731e-4c4e-8330-68633cae6e85"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.518632 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.518582    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bc89966b-fc69-4617-993d-3e5f383619bb" (UID: "bc89966b-fc69-4617-993d-3e5f383619bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.519064 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.519038    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-kube-api-access-8wjbv" (OuterVolumeSpecName: "kube-api-access-8wjbv") pod "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" (UID: "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9"). InnerVolumeSpecName "kube-api-access-8wjbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:12.519983 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.519949    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-dshm" (OuterVolumeSpecName: "dshm") pod "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" (UID: "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.520071 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.520043    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" (UID: "654fa3b0-bf5d-4489-9529-e1a0b5b7eae9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:12.520219 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.520128    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-dshm" (OuterVolumeSpecName: "dshm") pod "bc89966b-fc69-4617-993d-3e5f383619bb" (UID: "bc89966b-fc69-4617-993d-3e5f383619bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.520283 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.520250    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc89966b-fc69-4617-993d-3e5f383619bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bc89966b-fc69-4617-993d-3e5f383619bb" (UID: "bc89966b-fc69-4617-993d-3e5f383619bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:12.520891 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.520866    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-dshm" (OuterVolumeSpecName: "dshm") pod "61126d66-731e-4c4e-8330-68633cae6e85" (UID: "61126d66-731e-4c4e-8330-68633cae6e85"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:12.520958 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.520899    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc89966b-fc69-4617-993d-3e5f383619bb-kube-api-access-8cp8t" (OuterVolumeSpecName: "kube-api-access-8cp8t") pod "bc89966b-fc69-4617-993d-3e5f383619bb" (UID: "bc89966b-fc69-4617-993d-3e5f383619bb"). InnerVolumeSpecName "kube-api-access-8cp8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:12.617719 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617686    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc89966b-fc69-4617-993d-3e5f383619bb-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.617719 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617718    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617731    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617744    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617757    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cp8t\" (UniqueName: \"kubernetes.io/projected/bc89966b-fc69-4617-993d-3e5f383619bb-kube-api-access-8cp8t\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617773    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61126d66-731e-4c4e-8330-68633cae6e85-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617785    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617800    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617813    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64dq7\" (UniqueName: \"kubernetes.io/projected/61126d66-731e-4c4e-8330-68633cae6e85-kube-api-access-64dq7\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617827    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc89966b-fc69-4617-993d-3e5f383619bb-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617839    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61126d66-731e-4c4e-8330-68633cae6e85-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617852    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617863    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.618141 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.617873    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wjbv\" (UniqueName: \"kubernetes.io/projected/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9-kube-api-access-8wjbv\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.970336 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:12.970298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:13.032520 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.032488    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:13.132169 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.132131    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:13.232318 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.232228    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:13.400775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.400747    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"
Sep 20 01:14:13.400775 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.400760    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn" event={"ID":"654fa3b0-bf5d-4489-9529-e1a0b5b7eae9","Type":"ContainerDied","Data":"0b8f83fe91d8e81a2c0151ffadfc20fe1276de90245c932a1633b0d457b619d5"}
Sep 20 01:14:13.401008 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.400805    2571 scope.go:117] "RemoveContainer" containerID="8442d4b51438a12961d940cf326d216e1bbb631b021b1746e8848f5e4b3b3b6f"
Sep 20 01:14:13.402262 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.402234    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7" event={"ID":"bc89966b-fc69-4617-993d-3e5f383619bb","Type":"ContainerDied","Data":"653faee22404608c5f10f0648273ce0b068fe19ac8515de16fae0d0c190bab22"}
Sep 20 01:14:13.402372 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.402284    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"
Sep 20 01:14:13.404817 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.404796    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk" event={"ID":"61126d66-731e-4c4e-8330-68633cae6e85","Type":"ContainerDied","Data":"cc645c0afffb8b2c43c7993401121d502cf975d2fbbc58e426f49da694e40390"}
Sep 20 01:14:13.404925 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.404828    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"
Sep 20 01:14:13.417848 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.417824    2571 scope.go:117] "RemoveContainer" containerID="682f192c6969c285506cfc8645dbd6074a5974f96177326e9109eb3b702a589f"
Sep 20 01:14:13.425550 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.425531    2571 scope.go:117] "RemoveContainer" containerID="de94148e5a55b723464f3b3e49971ecd867548b34d5b9603e81bb1b6ba211a5f"
Sep 20 01:14:13.429843 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.429823    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"]
Sep 20 01:14:13.432717 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.432695    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/embedding-w0-e2e8bc-kserve-7d7f44b88c-phtnn"]
Sep 20 01:14:13.445012 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.444989    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"]
Sep 20 01:14:13.448572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.448550    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/premium-w0-e2e8bc-kserve-84f98f89f-gzskk"]
Sep 20 01:14:13.457911 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.457891    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"]
Sep 20 01:14:13.461428 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.461408    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e2e8bc/simulator-w0-e2e8bc-kserve-59fddf6f54-jc7q7"]
Sep 20 01:14:13.508979 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.508947    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61126d66-731e-4c4e-8330-68633cae6e85" path="/var/lib/kubelet/pods/61126d66-731e-4c4e-8330-68633cae6e85/volumes"
Sep 20 01:14:13.509450 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.509430    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" path="/var/lib/kubelet/pods/654fa3b0-bf5d-4489-9529-e1a0b5b7eae9/volumes"
Sep 20 01:14:13.509847 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.509829    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a8a3d3e-6ee1-4785-879e-8ceff0357076" path="/var/lib/kubelet/pods/8a8a3d3e-6ee1-4785-879e-8ceff0357076/volumes"
Sep 20 01:14:13.510317 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.510292    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc89966b-fc69-4617-993d-3e5f383619bb" path="/var/lib/kubelet/pods/bc89966b-fc69-4617-993d-3e5f383619bb/volumes"
Sep 20 01:14:13.510795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.510779    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfbeef66-98de-45de-83f0-95c24fd64594" path="/var/lib/kubelet/pods/dfbeef66-98de-45de-83f0-95c24fd64594/volumes"
Sep 20 01:14:13.526575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.526556    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:13.628489 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:13.628466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:14.490382 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:14.490349    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:14.852652 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:14.852620    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:14.952721 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:14.952688    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:15.108406 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:15.108323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:15.355171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:15.355138    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:15.655740 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:15.655706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:15.756796 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:15.756760    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:15.921662 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:15.921579    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"]
Sep 20 01:14:15.922098 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:15.921820    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" containerID="cri-o://6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32" gracePeriod=30
Sep 20 01:14:15.943407 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:15.943376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:16.187415 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:16.187329    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:19.091831 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:19.091787    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:19.158274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:19.158233    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:19.392355 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:19.392279    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:20.411187 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:20.411148    2571 patch_prober.go:28] interesting pod/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 01:14:20.411609 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:20.411249    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 01:14:20.622490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:20.622461    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:21.164835 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.164811    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:14:21.291930 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.291897    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-data\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.291930 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.291935    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-token\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.291992    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istiod-ca-cert\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292013    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-certs\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292053    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-credential-socket\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292084    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-envoy\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292110    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-socket\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292143    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-podinfo\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292515 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292177    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfgps\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-kube-api-access-kfgps\") pod \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\" (UID: \"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e\") "
Sep 20 01:14:21.292515 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292223    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-data" (OuterVolumeSpecName: "istio-data") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:21.292515 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292365    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:21.292515 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292385    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:21.292515 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292446    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:21.292515 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292469    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:21.292762 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292602    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.292762 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292621    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.292762 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292635    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.292762 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292650    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.292762 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.292663    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.294458 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.294424    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:21.294458 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.294445    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-token" (OuterVolumeSpecName: "istio-token") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:21.294741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.294718    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:14:21.294878 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.294861    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-kube-api-access-kfgps" (OuterVolumeSpecName: "kube-api-access-kfgps") pod "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" (UID: "63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e"). InnerVolumeSpecName "kube-api-access-kfgps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:21.320393 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.320365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:21.394226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.394174    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfgps\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-kube-api-access-kfgps\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.394226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.394222    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.394226 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.394234    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.394522 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.394242    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:21.453686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.453649    2571 generic.go:356] "Generic (PLEG): container finished" podID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerID="6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32" exitCode=0
Sep 20 01:14:21.454081 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.453709    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"
Sep 20 01:14:21.454081 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.453735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" event={"ID":"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e","Type":"ContainerDied","Data":"6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32"}
Sep 20 01:14:21.454081 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.453796    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj" event={"ID":"63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e","Type":"ContainerDied","Data":"22f97c214ca86a1b48938ba519798a00feb5a297f25226ed03231838f6704f12"}
Sep 20 01:14:21.454081 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.453820    2571 scope.go:117] "RemoveContainer" containerID="6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32"
Sep 20 01:14:21.463650 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.463632    2571 scope.go:117] "RemoveContainer" containerID="b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c"
Sep 20 01:14:21.471508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.471492    2571 scope.go:117] "RemoveContainer" containerID="6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32"
Sep 20 01:14:21.471775 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:14:21.471754    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32\": container with ID starting with 6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32 not found: ID does not exist" containerID="6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32"
Sep 20 01:14:21.471830 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.471786    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32"} err="failed to get container status \"6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32\": rpc error: code = NotFound desc = could not find container \"6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32\": container with ID starting with 6a73df86eb2879a965b22cd3d57a28e98c103a5bb13e54da6c160a907bed2e32 not found: ID does not exist"
Sep 20 01:14:21.471830 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.471803    2571 scope.go:117] "RemoveContainer" containerID="b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c"
Sep 20 01:14:21.472038 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:14:21.472023    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c\": container with ID starting with b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c not found: ID does not exist" containerID="b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c"
Sep 20 01:14:21.472083 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.472042    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c"} err="failed to get container status \"b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c\": rpc error: code = NotFound desc = could not find container \"b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c\": container with ID starting with b07dcde13950f811a1d53e27911d9480c8667d33bc43cf8aab9e0824a3cb954c not found: ID does not exist"
Sep 20 01:14:21.475754 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.475733    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"]
Sep 20 01:14:21.479401 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.479381    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj"]
Sep 20 01:14:21.511108 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:21.511085    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" path="/var/lib/kubelet/pods/63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e/volumes"
Sep 20 01:14:22.125946 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:22.125908    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:22.808074 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:22.808037    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:30.364090 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.363995    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:30.410868 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.410829    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"]
Sep 20 01:14:30.411087 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.411055    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd" podUID="dfa4ed94-6084-42cf-bfbe-ffdc590662a7" containerName="payload-pre-processing" containerID="cri-o://243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717" gracePeriod=30
Sep 20 01:14:30.437181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.437142    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:30.537586 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.537559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:30.637675 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.637602    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:30.669726 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.669702    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:14:30.782855 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.782819    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-plugins-config-volume\") pod \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") "
Sep 20 01:14:30.783027 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.782924    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbqkp\" (UniqueName: \"kubernetes.io/projected/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-kube-api-access-tbqkp\") pod \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\" (UID: \"dfa4ed94-6084-42cf-bfbe-ffdc590662a7\") "
Sep 20 01:14:30.783283 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.783260    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfa4ed94-6084-42cf-bfbe-ffdc590662a7" (UID: "dfa4ed94-6084-42cf-bfbe-ffdc590662a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:30.784993 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.784955    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-kube-api-access-tbqkp" (OuterVolumeSpecName: "kube-api-access-tbqkp") pod "dfa4ed94-6084-42cf-bfbe-ffdc590662a7" (UID: "dfa4ed94-6084-42cf-bfbe-ffdc590662a7"). InnerVolumeSpecName "kube-api-access-tbqkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:30.884363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.884338    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbqkp\" (UniqueName: \"kubernetes.io/projected/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-kube-api-access-tbqkp\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:30.884363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.884362    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfa4ed94-6084-42cf-bfbe-ffdc590662a7-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:14:30.947380 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:30.947304    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:31.047560 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.047531    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:31.508299 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.508263    2571 generic.go:356] "Generic (PLEG): container finished" podID="dfa4ed94-6084-42cf-bfbe-ffdc590662a7" containerID="243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717" exitCode=0
Sep 20 01:14:31.508752 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.508394    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"
Sep 20 01:14:31.509551 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.509525    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd" event={"ID":"dfa4ed94-6084-42cf-bfbe-ffdc590662a7","Type":"ContainerDied","Data":"243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717"}
Sep 20 01:14:31.509675 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.509572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd" event={"ID":"dfa4ed94-6084-42cf-bfbe-ffdc590662a7","Type":"ContainerDied","Data":"283657322dce09a97a42ce7a995fd46f41dafc404d36a89bef90941a5bb37507"}
Sep 20 01:14:31.509675 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.509601    2571 scope.go:117] "RemoveContainer" containerID="243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717"
Sep 20 01:14:31.520039 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.520018    2571 scope.go:117] "RemoveContainer" containerID="243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717"
Sep 20 01:14:31.520429 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:14:31.520399    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717\": container with ID starting with 243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717 not found: ID does not exist" containerID="243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717"
Sep 20 01:14:31.520523 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.520440    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717"} err="failed to get container status \"243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717\": rpc error: code = NotFound desc = could not find container \"243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717\": container with ID starting with 243d17ea05a0b34db9414bc8f0e453137074bb5d9be419302abc38922db8a717 not found: ID does not exist"
Sep 20 01:14:31.542248 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.542227    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"]
Sep 20 01:14:31.545350 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.545328    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd"]
Sep 20 01:14:31.795750 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:31.795662    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:32.315939 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:32.315892    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:32.376261 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:32.376221    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:32.641268 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:32.641159    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:33.509099 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:33.509068    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa4ed94-6084-42cf-bfbe-ffdc590662a7" path="/var/lib/kubelet/pods/dfa4ed94-6084-42cf-bfbe-ffdc590662a7/volumes"
Sep 20 01:14:33.703514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:33.703484    2571 scope.go:117] "RemoveContainer" containerID="850a321bffde53573d90b8b55d226988b11ecb0fe16efdc97fbae033f32058b3"
Sep 20 01:14:34.131850 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:34.131825    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:34.723337 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:34.723304    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:34.824105 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:34.824067    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:35.207477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:35.207448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:36.825496 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:36.825464    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:36.890909 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:36.890880    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:37.119696 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:37.119613    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:39.098135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:39.098095    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:14:39.677167 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:39.677140    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:44.407780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:44.407743    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:45.441555 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:45.441510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:49.470484 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:49.470452    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:14:52.493346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:14:52.493312    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:15:00.133752 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.133711    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"]
Sep 20 01:15:00.134291 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134272    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8a3d3e-6ee1-4785-879e-8ceff0357076" containerName="main"
Sep 20 01:15:00.134346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134294    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8a3d3e-6ee1-4785-879e-8ceff0357076" containerName="main"
Sep 20 01:15:00.134346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134305    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa4ed94-6084-42cf-bfbe-ffdc590662a7" containerName="payload-pre-processing"
Sep 20 01:15:00.134346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134315    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa4ed94-6084-42cf-bfbe-ffdc590662a7" containerName="payload-pre-processing"
Sep 20 01:15:00.134346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134323    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" containerName="main"
Sep 20 01:15:00.134346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134331    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" containerName="main"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134350    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfbeef66-98de-45de-83f0-95c24fd64594" containerName="main"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134358    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfbeef66-98de-45de-83f0-95c24fd64594" containerName="main"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134375    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61126d66-731e-4c4e-8330-68633cae6e85" containerName="main"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134383    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="61126d66-731e-4c4e-8330-68633cae6e85" containerName="main"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134393    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134402    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134412    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc997049-966e-4cbd-9ed8-b7243002b1c6" containerName="revoke-keys"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134421    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc997049-966e-4cbd-9ed8-b7243002b1c6" containerName="revoke-keys"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134433    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc89966b-fc69-4617-993d-3e5f383619bb" containerName="main"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134441    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc89966b-fc69-4617-993d-3e5f383619bb" containerName="main"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134454    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134462    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134474    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy"
Sep 20 01:15:00.134510 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134482    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134520    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" containerName="payload-pre-processing"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134528    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" containerName="payload-pre-processing"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134626    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134637    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="654fa3b0-bf5d-4489-9529-e1a0b5b7eae9" containerName="main"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134648    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134659    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc997049-966e-4cbd-9ed8-b7243002b1c6" containerName="revoke-keys"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134668    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e858225-8d59-44ce-83a7-dc1d9a7f4b9a" containerName="payload-pre-processing"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134679    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfbeef66-98de-45de-83f0-95c24fd64594" containerName="main"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134687    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8a3d3e-6ee1-4785-879e-8ceff0357076" containerName="main"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134718    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa4ed94-6084-42cf-bfbe-ffdc590662a7" containerName="payload-pre-processing"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134728    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc89966b-fc69-4617-993d-3e5f383619bb" containerName="main"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134736    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="61126d66-731e-4c4e-8330-68633cae6e85" containerName="main"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134745    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy"
Sep 20 01:15:00.134913 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.134755    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7261133a-68b3-44e8-a089-066ba00c026e" containerName="istio-proxy"
Sep 20 01:15:00.138455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.138433    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"
Sep 20 01:15:00.141476 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.141291    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:15:00.145839 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.145816    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"]
Sep 20 01:15:00.151609 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.151585    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"
Sep 20 01:15:00.423906 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.423865    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"]
Sep 20 01:15:00.426080 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:15:00.426051    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5927ba3_28e9_4052_9a1f_75a1795462c5.slice/crio-21af678567b4bb047669d27eea9f94e07118a1cecf677d7748ed68f3f99d6651 WatchSource:0}: Error finding container 21af678567b4bb047669d27eea9f94e07118a1cecf677d7748ed68f3f99d6651: Status 404 returned error can't find the container with id 21af678567b4bb047669d27eea9f94e07118a1cecf677d7748ed68f3f99d6651
Sep 20 01:15:00.656830 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:00.656798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl" event={"ID":"f5927ba3-28e9-4052-9a1f-75a1795462c5","Type":"ContainerStarted","Data":"21af678567b4bb047669d27eea9f94e07118a1cecf677d7748ed68f3f99d6651"}
Sep 20 01:15:01.664014 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:01.663926    2571 generic.go:356] "Generic (PLEG): container finished" podID="f5927ba3-28e9-4052-9a1f-75a1795462c5" containerID="53ff1de37184f1af05843b908fff9d333e5907cb8c6cabba89814dfa57f66535" exitCode=0
Sep 20 01:15:01.664383 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:01.664014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl" event={"ID":"f5927ba3-28e9-4052-9a1f-75a1795462c5","Type":"ContainerDied","Data":"53ff1de37184f1af05843b908fff9d333e5907cb8c6cabba89814dfa57f66535"}
Sep 20 01:15:02.795361 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:02.795334    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"
Sep 20 01:15:03.674757 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:03.674730    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"
Sep 20 01:15:03.674923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:03.674721    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl" event={"ID":"f5927ba3-28e9-4052-9a1f-75a1795462c5","Type":"ContainerDied","Data":"21af678567b4bb047669d27eea9f94e07118a1cecf677d7748ed68f3f99d6651"}
Sep 20 01:15:03.674923 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:03.674860    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21af678567b4bb047669d27eea9f94e07118a1cecf677d7748ed68f3f99d6651"
Sep 20 01:15:05.499620 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:05.499575    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:15:11.616293 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:11.616253    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"]
Sep 20 01:15:11.636043 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:11.636012    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:15:12.689335 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:12.689297    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"]
Sep 20 01:15:12.709810 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:12.709780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:15:18.233384 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:18.233343    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:15:21.995864 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:21.995832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:15:24.848992 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:24.848959    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:15:24.913857 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:24.913828    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:15:26.635799 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:26.635742    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd" podUID="3919da3c-5f37-46c0-a3b2-8990562314c6" containerName="main" containerID="cri-o://f6f90030065a829e7a97e4653c67f0ec95f1c9cae1bc6b8c62edcf6667abfd2f" gracePeriod=45
Sep 20 01:15:26.787548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:26.787513    2571 generic.go:356] "Generic (PLEG): container finished" podID="3919da3c-5f37-46c0-a3b2-8990562314c6" containerID="f6f90030065a829e7a97e4653c67f0ec95f1c9cae1bc6b8c62edcf6667abfd2f" exitCode=0
Sep 20 01:15:26.787681 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:26.787584    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd" event={"ID":"3919da3c-5f37-46c0-a3b2-8990562314c6","Type":"ContainerDied","Data":"f6f90030065a829e7a97e4653c67f0ec95f1c9cae1bc6b8c62edcf6667abfd2f"}
Sep 20 01:15:26.894490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:26.894437    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:15:27.027651 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027620    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-model-cache\") pod \"3919da3c-5f37-46c0-a3b2-8990562314c6\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") "
Sep 20 01:15:27.027814 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027656    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-home\") pod \"3919da3c-5f37-46c0-a3b2-8990562314c6\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") "
Sep 20 01:15:27.027814 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027711    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3919da3c-5f37-46c0-a3b2-8990562314c6-tls-certs\") pod \"3919da3c-5f37-46c0-a3b2-8990562314c6\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") "
Sep 20 01:15:27.027814 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027729    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kb2m\" (UniqueName: \"kubernetes.io/projected/3919da3c-5f37-46c0-a3b2-8990562314c6-kube-api-access-7kb2m\") pod \"3919da3c-5f37-46c0-a3b2-8990562314c6\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") "
Sep 20 01:15:27.027814 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027752    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-dshm\") pod \"3919da3c-5f37-46c0-a3b2-8990562314c6\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") "
Sep 20 01:15:27.027814 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027766    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-tmp-dir\") pod \"3919da3c-5f37-46c0-a3b2-8990562314c6\" (UID: \"3919da3c-5f37-46c0-a3b2-8990562314c6\") "
Sep 20 01:15:27.028072 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027893    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "3919da3c-5f37-46c0-a3b2-8990562314c6" (UID: "3919da3c-5f37-46c0-a3b2-8990562314c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:27.028072 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.027980    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-home" (OuterVolumeSpecName: "home") pod "3919da3c-5f37-46c0-a3b2-8990562314c6" (UID: "3919da3c-5f37-46c0-a3b2-8990562314c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:27.028185 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.028078    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:27.028185 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.028101    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3919da3c-5f37-46c0-a3b2-8990562314c6" (UID: "3919da3c-5f37-46c0-a3b2-8990562314c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:27.029915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.029880    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3919da3c-5f37-46c0-a3b2-8990562314c6-kube-api-access-7kb2m" (OuterVolumeSpecName: "kube-api-access-7kb2m") pod "3919da3c-5f37-46c0-a3b2-8990562314c6" (UID: "3919da3c-5f37-46c0-a3b2-8990562314c6"). InnerVolumeSpecName "kube-api-access-7kb2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:15:27.029915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.029908    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3919da3c-5f37-46c0-a3b2-8990562314c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3919da3c-5f37-46c0-a3b2-8990562314c6" (UID: "3919da3c-5f37-46c0-a3b2-8990562314c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:15:27.030062 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.029909    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-dshm" (OuterVolumeSpecName: "dshm") pod "3919da3c-5f37-46c0-a3b2-8990562314c6" (UID: "3919da3c-5f37-46c0-a3b2-8990562314c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:27.129003 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.128977    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3919da3c-5f37-46c0-a3b2-8990562314c6-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:27.129003 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.129000    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kb2m\" (UniqueName: \"kubernetes.io/projected/3919da3c-5f37-46c0-a3b2-8990562314c6-kube-api-access-7kb2m\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:27.129143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.129013    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:27.129143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.129026    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:27.129143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.129038    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3919da3c-5f37-46c0-a3b2-8990562314c6-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:27.708512 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.708449    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p" podUID="c22209c5-4bed-42cd-bb2d-3b3c51ca9330" containerName="main" containerID="cri-o://32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1" gracePeriod=45
Sep 20 01:15:27.794539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.794489    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"
Sep 20 01:15:27.794539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.794521    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd" event={"ID":"3919da3c-5f37-46c0-a3b2-8990562314c6","Type":"ContainerDied","Data":"6b655158233cbe249a0fe4d51fde24c97ce4446213e45d55f990c7d56268b5ca"}
Sep 20 01:15:27.794721 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.794588    2571 scope.go:117] "RemoveContainer" containerID="f6f90030065a829e7a97e4653c67f0ec95f1c9cae1bc6b8c62edcf6667abfd2f"
Sep 20 01:15:27.809874 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.809846    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"]
Sep 20 01:15:27.815228 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.815183    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/auth-test-model-d1662a-kserve-86c967dd59-g6xqd"]
Sep 20 01:15:27.962044 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:27.962020    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:15:28.036929 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.036902    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-dshm\") pod \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") "
Sep 20 01:15:28.037051 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.036967    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tls-certs\") pod \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") "
Sep 20 01:15:28.037051 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.036991    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-home\") pod \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") "
Sep 20 01:15:28.037186 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8gg6\" (UniqueName: \"kubernetes.io/projected/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-kube-api-access-j8gg6\") pod \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") "
Sep 20 01:15:28.037186 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037107    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tmp-dir\") pod \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") "
Sep 20 01:15:28.037186 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037150    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-model-cache\") pod \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\" (UID: \"c22209c5-4bed-42cd-bb2d-3b3c51ca9330\") "
Sep 20 01:15:28.037379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037294    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-home" (OuterVolumeSpecName: "home") pod "c22209c5-4bed-42cd-bb2d-3b3c51ca9330" (UID: "c22209c5-4bed-42cd-bb2d-3b3c51ca9330"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:28.037466 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037438    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c22209c5-4bed-42cd-bb2d-3b3c51ca9330" (UID: "c22209c5-4bed-42cd-bb2d-3b3c51ca9330"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:28.037466 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037449    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-model-cache" (OuterVolumeSpecName: "model-cache") pod "c22209c5-4bed-42cd-bb2d-3b3c51ca9330" (UID: "c22209c5-4bed-42cd-bb2d-3b3c51ca9330"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:28.037590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037555    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:28.037590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037567    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:28.037590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.037577    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:28.039317 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.039293    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-kube-api-access-j8gg6" (OuterVolumeSpecName: "kube-api-access-j8gg6") pod "c22209c5-4bed-42cd-bb2d-3b3c51ca9330" (UID: "c22209c5-4bed-42cd-bb2d-3b3c51ca9330"). InnerVolumeSpecName "kube-api-access-j8gg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:15:28.039573 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.039554    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-dshm" (OuterVolumeSpecName: "dshm") pod "c22209c5-4bed-42cd-bb2d-3b3c51ca9330" (UID: "c22209c5-4bed-42cd-bb2d-3b3c51ca9330"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:15:28.039646 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.039556    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c22209c5-4bed-42cd-bb2d-3b3c51ca9330" (UID: "c22209c5-4bed-42cd-bb2d-3b3c51ca9330"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:15:28.138716 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.138662    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:28.138716 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.138683    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8gg6\" (UniqueName: \"kubernetes.io/projected/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-kube-api-access-j8gg6\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:28.138716 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.138693    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c22209c5-4bed-42cd-bb2d-3b3c51ca9330-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:15:28.801630 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.801593    2571 generic.go:356] "Generic (PLEG): container finished" podID="c22209c5-4bed-42cd-bb2d-3b3c51ca9330" containerID="32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1" exitCode=0
Sep 20 01:15:28.802063 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.801641    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"
Sep 20 01:15:28.802063 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.801686    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p" event={"ID":"c22209c5-4bed-42cd-bb2d-3b3c51ca9330","Type":"ContainerDied","Data":"32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1"}
Sep 20 01:15:28.802063 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.801735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p" event={"ID":"c22209c5-4bed-42cd-bb2d-3b3c51ca9330","Type":"ContainerDied","Data":"17685e7cf23f7f3561caa767b9df69549fd6e47560dc9137bc83484d11fa2395"}
Sep 20 01:15:28.802063 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.801754    2571 scope.go:117] "RemoveContainer" containerID="32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1"
Sep 20 01:15:28.811491 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.811471    2571 scope.go:117] "RemoveContainer" containerID="32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1"
Sep 20 01:15:28.811797 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:15:28.811776    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1\": container with ID starting with 32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1 not found: ID does not exist" containerID="32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1"
Sep 20 01:15:28.811863 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.811813    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1"} err="failed to get container status \"32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1\": rpc error: code = NotFound desc = could not find container \"32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1\": container with ID starting with 32462e5abd79698068410199a68c19dca56a916679a3554d94efc461aa0f9ff1 not found: ID does not exist"
Sep 20 01:15:28.822579 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.822551    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"]
Sep 20 01:15:28.825926 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:28.825899    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/auth-test-model-4c93ee-kserve-6bdb5dc859-lf47p"]
Sep 20 01:15:29.510434 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:29.510403    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3919da3c-5f37-46c0-a3b2-8990562314c6" path="/var/lib/kubelet/pods/3919da3c-5f37-46c0-a3b2-8990562314c6/volumes"
Sep 20 01:15:29.510825 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:15:29.510809    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c22209c5-4bed-42cd-bb2d-3b3c51ca9330" path="/var/lib/kubelet/pods/c22209c5-4bed-42cd-bb2d-3b3c51ca9330/volumes"
Sep 20 01:16:05.011745 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:05.011700    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:16:08.604230 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:08.604180    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:16:21.692739 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:21.692703    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:16:32.083506 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:32.083470    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:16:33.772501 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:33.772465    2571 scope.go:117] "RemoveContainer" containerID="aabd414530a72b225b31cbc30913c5f0550d993194e0f99985dd5b3a9b7db572"
Sep 20 01:16:37.095622 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:37.095576    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:16:38.697124 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:38.697080    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:16:39.828690 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:39.828659    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:16:45.883088 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883043    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"]
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883567    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy"
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883588    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c14a0c-ad1f-4ca5-b61b-cf1069c6b55e" containerName="istio-proxy"
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883613    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22209c5-4bed-42cd-bb2d-3b3c51ca9330" containerName="main"
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883621    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22209c5-4bed-42cd-bb2d-3b3c51ca9330" containerName="main"
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883630    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5927ba3-28e9-4052-9a1f-75a1795462c5" containerName="cleanup"
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883639    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5927ba3-28e9-4052-9a1f-75a1795462c5" containerName="cleanup"
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883652    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3919da3c-5f37-46c0-a3b2-8990562314c6" containerName="main"
Sep 20 01:16:45.883686 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883662    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3919da3c-5f37-46c0-a3b2-8990562314c6" containerName="main"
Sep 20 01:16:45.884097 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883764    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5927ba3-28e9-4052-9a1f-75a1795462c5" containerName="cleanup"
Sep 20 01:16:45.884097 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883777    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3919da3c-5f37-46c0-a3b2-8990562314c6" containerName="main"
Sep 20 01:16:45.884097 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.883789    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22209c5-4bed-42cd-bb2d-3b3c51ca9330" containerName="main"
Sep 20 01:16:45.887041 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.887018    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:45.890626 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.890601    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"openshift-service-ca.crt\""
Sep 20 01:16:45.890742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.890635    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"kube-root-ca.crt\""
Sep 20 01:16:45.890742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.890675    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"rate-test-model-d1662a-kserve-self-signed-certs\""
Sep 20 01:16:45.890742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.890644    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"default-dockercfg-kp6ds\""
Sep 20 01:16:45.897817 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.897796    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"]
Sep 20 01:16:45.908732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:45.908710    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:16:46.041293 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.041262    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-home\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.041467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.041321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tls-certs\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.041467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.041377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tmp-dir\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.041467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.041406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2sxz\" (UniqueName: \"kubernetes.io/projected/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-kube-api-access-v2sxz\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.041467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.041425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-dshm\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.041467 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.041442    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-model-cache\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.142611 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.142523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tmp-dir\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.142611 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.142575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2sxz\" (UniqueName: \"kubernetes.io/projected/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-kube-api-access-v2sxz\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.142611 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.142596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-dshm\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.142887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.142616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-model-cache\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.142887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.142660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-home\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.142887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.142695    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tls-certs\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.143057 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.143035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tmp-dir\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.143126 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.143090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-model-cache\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.143182 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.143139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-home\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.144887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.144870    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-dshm\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.145177 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.145157    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tls-certs\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.149915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.149891    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2sxz\" (UniqueName: \"kubernetes.io/projected/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-kube-api-access-v2sxz\") pod \"rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.196920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.196888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:46.465278 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:46.465252    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"]
Sep 20 01:16:46.467359 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:16:46.467327    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f0d78c1_2430_42ca_a92a_d4207ee9c49b.slice/crio-d072d7c35f57668c877043b61910c41ae16cb74b89d865d3eb7cb3cdd3426ade WatchSource:0}: Error finding container d072d7c35f57668c877043b61910c41ae16cb74b89d865d3eb7cb3cdd3426ade: Status 404 returned error can't find the container with id d072d7c35f57668c877043b61910c41ae16cb74b89d865d3eb7cb3cdd3426ade
Sep 20 01:16:47.200396 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:47.200357    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq" event={"ID":"1f0d78c1-2430-42ca-a92a-d4207ee9c49b","Type":"ContainerStarted","Data":"6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296"}
Sep 20 01:16:47.200768 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:47.200408    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq" event={"ID":"1f0d78c1-2430-42ca-a92a-d4207ee9c49b","Type":"ContainerStarted","Data":"d072d7c35f57668c877043b61910c41ae16cb74b89d865d3eb7cb3cdd3426ade"}
Sep 20 01:16:47.217168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:47.217094    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq" podStartSLOduration=2.2170787929999998 podStartE2EDuration="2.217078793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:16:47.215701252 +0000 UTC m=+1754.208976785" watchObservedRunningTime="2026-09-20 01:16:47.217078793 +0000 UTC m=+1754.210354350"
Sep 20 01:16:48.802164 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:48.802129    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:16:56.197329 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:56.197288    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:56.197796 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:56.197341    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:56.209953 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:56.209927    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:16:56.255100 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:16:56.255069    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:17:20.240619 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:20.240584    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:17:23.601097 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:23.601059    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:17:38.527623 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:38.527587    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:17:42.791287 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:42.791248    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:17:52.194284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:52.194238    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:17:58.575668 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:58.575630    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"]
Sep 20 01:17:58.598135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:58.598101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:17:59.706299 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:17:59.706258    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:00.146441 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:00.146407    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:00.435044 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:00.434949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:00.637990 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:00.637943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:02.807856 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:02.807824    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:18:02.902619 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:02.902583    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:03.608187 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:03.608151    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:03.679424 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:03.679388    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:04.451595 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:04.451559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:05.285237 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:05.285179    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:05.385064 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:05.385030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:05.663203 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:05.663100    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:05.768435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:05.768403    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:05.865136 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:05.865090    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:13.594500 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.594441    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq" podUID="1f0d78c1-2430-42ca-a92a-d4207ee9c49b" containerName="main" containerID="cri-o://6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296" gracePeriod=45
Sep 20 01:18:13.845436 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.845373    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:18:13.896696 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.896665    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-dshm\") pod \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") "
Sep 20 01:18:13.896887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.896736    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tmp-dir\") pod \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") "
Sep 20 01:18:13.896887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.896755    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-home\") pod \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") "
Sep 20 01:18:13.896887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.896801    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-model-cache\") pod \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") "
Sep 20 01:18:13.896887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.896828    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2sxz\" (UniqueName: \"kubernetes.io/projected/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-kube-api-access-v2sxz\") pod \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") "
Sep 20 01:18:13.896887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.896869    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tls-certs\") pod \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\" (UID: \"1f0d78c1-2430-42ca-a92a-d4207ee9c49b\") "
Sep 20 01:18:13.897154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.897049    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f0d78c1-2430-42ca-a92a-d4207ee9c49b" (UID: "1f0d78c1-2430-42ca-a92a-d4207ee9c49b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:13.897154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.897063    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f0d78c1-2430-42ca-a92a-d4207ee9c49b" (UID: "1f0d78c1-2430-42ca-a92a-d4207ee9c49b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:13.897154 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.897074    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-home" (OuterVolumeSpecName: "home") pod "1f0d78c1-2430-42ca-a92a-d4207ee9c49b" (UID: "1f0d78c1-2430-42ca-a92a-d4207ee9c49b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:13.897352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.897224    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:18:13.897352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.897245    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:18:13.897352 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.897259    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:18:13.898974 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.898950    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f0d78c1-2430-42ca-a92a-d4207ee9c49b" (UID: "1f0d78c1-2430-42ca-a92a-d4207ee9c49b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:18:13.899088 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.899012    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-kube-api-access-v2sxz" (OuterVolumeSpecName: "kube-api-access-v2sxz") pod "1f0d78c1-2430-42ca-a92a-d4207ee9c49b" (UID: "1f0d78c1-2430-42ca-a92a-d4207ee9c49b"). InnerVolumeSpecName "kube-api-access-v2sxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:18:13.899088 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.899045    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-dshm" (OuterVolumeSpecName: "dshm") pod "1f0d78c1-2430-42ca-a92a-d4207ee9c49b" (UID: "1f0d78c1-2430-42ca-a92a-d4207ee9c49b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:13.998403 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.998367    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:18:13.998403 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.998396    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2sxz\" (UniqueName: \"kubernetes.io/projected/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-kube-api-access-v2sxz\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:18:13.998403 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:13.998407    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0d78c1-2430-42ca-a92a-d4207ee9c49b-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:18:14.615485 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.615446    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f0d78c1-2430-42ca-a92a-d4207ee9c49b" containerID="6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296" exitCode=0
Sep 20 01:18:14.615879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.615491    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"
Sep 20 01:18:14.615879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.615531    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq" event={"ID":"1f0d78c1-2430-42ca-a92a-d4207ee9c49b","Type":"ContainerDied","Data":"6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296"}
Sep 20 01:18:14.615879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.615577    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq" event={"ID":"1f0d78c1-2430-42ca-a92a-d4207ee9c49b","Type":"ContainerDied","Data":"d072d7c35f57668c877043b61910c41ae16cb74b89d865d3eb7cb3cdd3426ade"}
Sep 20 01:18:14.615879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.615598    2571 scope.go:117] "RemoveContainer" containerID="6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296"
Sep 20 01:18:14.624611 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.624592    2571 scope.go:117] "RemoveContainer" containerID="6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296"
Sep 20 01:18:14.624864 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:18:14.624844    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296\": container with ID starting with 6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296 not found: ID does not exist" containerID="6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296"
Sep 20 01:18:14.624927 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.624875    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296"} err="failed to get container status \"6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296\": rpc error: code = NotFound desc = could not find container \"6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296\": container with ID starting with 6251b172766b2689056179193171cc87cc6e3aef585f199d60171cbe22759296 not found: ID does not exist"
Sep 20 01:18:14.637981 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.637958    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"]
Sep 20 01:18:14.642719 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:14.642695    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/rate-test-model-d1662a-kserve-5c4b6688b7-pjnrq"]
Sep 20 01:18:15.502906 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:15.502871    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:18:15.513381 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:15.509988    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f0d78c1-2430-42ca-a92a-d4207ee9c49b" path="/var/lib/kubelet/pods/1f0d78c1-2430-42ca-a92a-d4207ee9c49b/volumes"
Sep 20 01:18:27.181168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:27.181134    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:28.649129 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:28.649096    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:29.179786 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:29.179745    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:29.313084 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:29.313047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:29.480092 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:29.480005    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:29.724639 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:29.724605    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:32.630948 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:32.630915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:32.736697 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:32.736662    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:32.830750 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:32.830711    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:33.501113 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:33.501072    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:34.340350 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:34.340318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:35.048624 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:35.048581    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:35.152442 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:35.152405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:35.380254 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:35.380152    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:35.534599 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:35.534564    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:35.631478 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:35.631384    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:40.417002 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:40.416961    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:40.505092 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:40.505058    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:18:56.030711 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:56.030627    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:57.312517 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:57.312484    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:57.702961 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:57.702860    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:57.977800 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:57.977707    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:58.947240 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:58.947183    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:18:59.674552 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:18:59.674517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:00.506968 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:00.506930    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:10.446665 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:10.446574    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:14.501066 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.501030    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"]
Sep 20 01:19:14.501478 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.501423    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0d78c1-2430-42ca-a92a-d4207ee9c49b" containerName="main"
Sep 20 01:19:14.501478 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.501436    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0d78c1-2430-42ca-a92a-d4207ee9c49b" containerName="main"
Sep 20 01:19:14.501555 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.501498    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f0d78c1-2430-42ca-a92a-d4207ee9c49b" containerName="main"
Sep 20 01:19:14.504419 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.504396    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.508492 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.508467    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e458de\"/\"kube-root-ca.crt\""
Sep 20 01:19:14.508660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.508502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e458de\"/\"ipp-route-e458de-kserve-self-signed-certs\""
Sep 20 01:19:14.508660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.508502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e458de\"/\"default-dockercfg-wx24l\""
Sep 20 01:19:14.508660 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.508549    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e458de\"/\"openshift-service-ca.crt\""
Sep 20 01:19:14.512922 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.512902    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"]
Sep 20 01:19:14.595125 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.595090    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:14.643034 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.643004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-dshm\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.643173 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.643045    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a538ba-d3e0-44db-a8b0-c6b831df9148-tls-certs\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.643253 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.643232    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-home\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.643298 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.643266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqjk\" (UniqueName: \"kubernetes.io/projected/98a538ba-d3e0-44db-a8b0-c6b831df9148-kube-api-access-tjqjk\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.643458 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.643444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-model-cache\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.643497 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.643472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-tmp-dir\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.744607 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.744574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-dshm\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.744767 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.744615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a538ba-d3e0-44db-a8b0-c6b831df9148-tls-certs\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.744767 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.744638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-home\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.744767 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.744753    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqjk\" (UniqueName: \"kubernetes.io/projected/98a538ba-d3e0-44db-a8b0-c6b831df9148-kube-api-access-tjqjk\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.744887 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.744848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-model-cache\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.744935 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.744884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-tmp-dir\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.745111 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.745082    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-home\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.745278 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.745248    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-model-cache\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.745341 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.745248    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-tmp-dir\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.746967 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.746947    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-dshm\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.747293 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.747272    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a538ba-d3e0-44db-a8b0-c6b831df9148-tls-certs\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.752337 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.752283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqjk\" (UniqueName: \"kubernetes.io/projected/98a538ba-d3e0-44db-a8b0-c6b831df9148-kube-api-access-tjqjk\") pod \"ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") " pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:14.814629 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:14.814593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:15.085013 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:15.084797    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"]
Sep 20 01:19:15.089067 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:19:15.089036    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98a538ba_d3e0_44db_a8b0_c6b831df9148.slice/crio-180843812b3a5371f7ee2979b5655ff9eb93f8ff04922766855def7873820723 WatchSource:0}: Error finding container 180843812b3a5371f7ee2979b5655ff9eb93f8ff04922766855def7873820723: Status 404 returned error can't find the container with id 180843812b3a5371f7ee2979b5655ff9eb93f8ff04922766855def7873820723
Sep 20 01:19:15.905783 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:15.905736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr" event={"ID":"98a538ba-d3e0-44db-a8b0-c6b831df9148","Type":"ContainerStarted","Data":"c128fa33c8db4848dc38821a6d5196d60c180bd1de266a8a127e5d303b6b81a7"}
Sep 20 01:19:15.905783 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:15.905785    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr" event={"ID":"98a538ba-d3e0-44db-a8b0-c6b831df9148","Type":"ContainerStarted","Data":"180843812b3a5371f7ee2979b5655ff9eb93f8ff04922766855def7873820723"}
Sep 20 01:19:15.923419 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:15.923360    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr" podStartSLOduration=1.923345088 podStartE2EDuration="1.923345088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:19:15.921722852 +0000 UTC m=+1902.914998384" watchObservedRunningTime="2026-09-20 01:19:15.923345088 +0000 UTC m=+1902.916620620"
Sep 20 01:19:18.907437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:18.907397    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:19:24.815162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:24.815112    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:24.815162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:24.815175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:24.827853 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:24.827826    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:24.959956 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:24.959927    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:19:32.496904 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:32.496865    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:19:33.810381 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:33.810350    2571 scope.go:117] "RemoveContainer" containerID="0e0b8b2c60f6464e360ee9ac99eb32db3dfc86236bb41a8b5f228918bb63a9b8"
Sep 20 01:19:39.406588 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.406548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:39.682229 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.682129    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"]
Sep 20 01:19:39.686134 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.686113    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.689971 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.689943    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-e6d769-openshift-default-dockercfg-9wbm7\""
Sep 20 01:19:39.697572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.697546    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"]
Sep 20 01:19:39.712146 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.712115    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:39.778165 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-certs\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778334 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-podinfo\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778334 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778289    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-credential-socket\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778413 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-data\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-socket\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778497 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-envoy\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778532 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-token\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778577 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02f228a-3e14-451d-9654-5dbd1b5104b9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.778612 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.778597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk7dj\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-kube-api-access-wk7dj\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.879921 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.879887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-envoy\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.879921 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.879921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-token\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880126 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.879939    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02f228a-3e14-451d-9654-5dbd1b5104b9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880126 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7dj\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-kube-api-access-wk7dj\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880257 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-certs\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880257 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-podinfo\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880369 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880272    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-credential-socket\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880369 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-data\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880475 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-socket\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880614 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-certs\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880733 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880642    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-credential-socket\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880799 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-socket\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880856 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-data\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.880920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.880836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02f228a-3e14-451d-9654-5dbd1b5104b9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.882387 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.882363    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-envoy\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.882608 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.882588    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-podinfo\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.887780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.887759    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-token\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.887904 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.887806    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7dj\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-kube-api-access-wk7dj\") pod \"e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") " pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:39.998261 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:39.998240    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:40.019457 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:40.019428    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:40.273889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:40.273861    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"]
Sep 20 01:19:40.276537 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:19:40.276507    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02f228a_3e14_451d_9654_5dbd1b5104b9.slice/crio-4d37802f435d021a9fc6546c58b618f0886bfde69589354184e0acf5a2c63338 WatchSource:0}: Error finding container 4d37802f435d021a9fc6546c58b618f0886bfde69589354184e0acf5a2c63338: Status 404 returned error can't find the container with id 4d37802f435d021a9fc6546c58b618f0886bfde69589354184e0acf5a2c63338
Sep 20 01:19:40.278936 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:40.278900    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:19:40.279024 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:40.278969    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:19:40.279024 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:40.278998    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:19:41.028570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:41.028533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" event={"ID":"b02f228a-3e14-451d-9654-5dbd1b5104b9","Type":"ContainerStarted","Data":"bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc"}
Sep 20 01:19:41.029013 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:41.028586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" event={"ID":"b02f228a-3e14-451d-9654-5dbd1b5104b9","Type":"ContainerStarted","Data":"4d37802f435d021a9fc6546c58b618f0886bfde69589354184e0acf5a2c63338"}
Sep 20 01:19:41.049770 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:41.049717    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podStartSLOduration=2.049701806 podStartE2EDuration="2.049701806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:19:41.047535722 +0000 UTC m=+1928.040811247" watchObservedRunningTime="2026-09-20 01:19:41.049701806 +0000 UTC m=+1928.042977339"
Sep 20 01:19:41.805319 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:41.805284    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:41.906030 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:41.905994    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:41.999181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:41.999152    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:42.004453 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:42.004429    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:42.033778 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:42.033753    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:42.035087 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:42.035068    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:19:42.832272 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:42.832236    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:42.940294 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:42.940249    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:43.031130 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:43.031099    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:43.817047 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:43.817013    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:44.610934 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:44.610895    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:45.372715 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:45.372682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:46.023894 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:46.023853    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:46.077211 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:46.077165    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:46.177837 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:46.177805    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:46.490499 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:46.490415    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:46.584648 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:46.584619    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:46.894904 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:46.894866    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:47.729734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:47.729698    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:19:51.894247 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:19:51.894213    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:20:01.137912 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:01.137828    2571 generic.go:356] "Generic (PLEG): container finished" podID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerID="bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc" exitCode=0
Sep 20 01:20:01.137912 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:01.137900    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" event={"ID":"b02f228a-3e14-451d-9654-5dbd1b5104b9","Type":"ContainerDied","Data":"bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc"}
Sep 20 01:20:01.138368 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:01.138348    2571 scope.go:117] "RemoveContainer" containerID="bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc"
Sep 20 01:20:01.139497 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:01.139467    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:20:01.139574 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:01.139537    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:20:01.139574 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:01.139568    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 20 01:20:02.148007 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:02.147962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" event={"ID":"b02f228a-3e14-451d-9654-5dbd1b5104b9","Type":"ContainerStarted","Data":"a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8"}
Sep 20 01:20:02.999108 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:02.999074    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:20:02.999364 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:02.999338    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 20 01:20:02.999411 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:02.999393    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 20 01:20:03.999290 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:03.999257    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 20 01:20:03.999792 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:03.999322    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 20 01:20:04.998915 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:04.998872    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 20 01:20:04.999217 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:04.998930    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 20 01:20:05.999276 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:05.999240    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 20 01:20:05.999773 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:05.999743    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 20 01:20:06.999338 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:06.999293    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 20 01:20:06.999839 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:06.999367    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 20 01:20:07.913508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:07.913470    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:08.008020 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.007988    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:20:08.008503 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.008399    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:20:08.009299 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.009280    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:20:08.013829 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.013798    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:08.687411 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.687368    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"]
Sep 20 01:20:08.690770 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.690751    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"
Sep 20 01:20:08.693246 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.693214    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:20:08.693246 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.693230    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:20:08.699096 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.698747    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"]
Sep 20 01:20:08.764508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.764476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff166445-27eb-484b-9341-91744fe3351e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln\" (UID: \"ff166445-27eb-484b-9341-91744fe3351e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"
Sep 20 01:20:08.804300 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.804263    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:08.865676 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.865648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff166445-27eb-484b-9341-91744fe3351e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln\" (UID: \"ff166445-27eb-484b-9341-91744fe3351e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"
Sep 20 01:20:08.866311 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:08.866294    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff166445-27eb-484b-9341-91744fe3351e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln\" (UID: \"ff166445-27eb-484b-9341-91744fe3351e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"
Sep 20 01:20:09.004210 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:09.004169    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"
Sep 20 01:20:09.273521 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:09.273498    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"]
Sep 20 01:20:09.275660 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:20:09.275631    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff166445_27eb_484b_9341_91744fe3351e.slice/crio-dbefac0d591dc772b2447083b763cea4b46c4d73027845ecc33286c157e6d564 WatchSource:0}: Error finding container dbefac0d591dc772b2447083b763cea4b46c4d73027845ecc33286c157e6d564: Status 404 returned error can't find the container with id dbefac0d591dc772b2447083b763cea4b46c4d73027845ecc33286c157e6d564
Sep 20 01:20:09.646466 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:09.646421    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:10.193952 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:10.193872    2571 generic.go:356] "Generic (PLEG): container finished" podID="ff166445-27eb-484b-9341-91744fe3351e" containerID="3cfa50591cfbdd82fa34ee86b874382d58ffeaae6b38136574c77e479ce7348a" exitCode=0
Sep 20 01:20:10.194102 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:10.193962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln" event={"ID":"ff166445-27eb-484b-9341-91744fe3351e","Type":"ContainerDied","Data":"3cfa50591cfbdd82fa34ee86b874382d58ffeaae6b38136574c77e479ce7348a"}
Sep 20 01:20:10.194102 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:10.194018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln" event={"ID":"ff166445-27eb-484b-9341-91744fe3351e","Type":"ContainerStarted","Data":"dbefac0d591dc772b2447083b763cea4b46c4d73027845ecc33286c157e6d564"}
Sep 20 01:20:10.402564 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:10.402532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:11.210507 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:11.210478    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:11.338739 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:11.338713    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"
Sep 20 01:20:11.389679 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:11.389649    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff166445-27eb-484b-9341-91744fe3351e-maas-api-service-ca\") pod \"ff166445-27eb-484b-9341-91744fe3351e\" (UID: \"ff166445-27eb-484b-9341-91744fe3351e\") "
Sep 20 01:20:11.389971 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:11.389951    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff166445-27eb-484b-9341-91744fe3351e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ff166445-27eb-484b-9341-91744fe3351e" (UID: "ff166445-27eb-484b-9341-91744fe3351e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:11.490327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:11.490256    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff166445-27eb-484b-9341-91744fe3351e-maas-api-service-ca\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:11.878075 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:11.878039    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:12.204519 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:12.204423    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"
Sep 20 01:20:12.204519 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:12.204447    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln" event={"ID":"ff166445-27eb-484b-9341-91744fe3351e","Type":"ContainerDied","Data":"dbefac0d591dc772b2447083b763cea4b46c4d73027845ecc33286c157e6d564"}
Sep 20 01:20:12.204519 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:12.204515    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbefac0d591dc772b2447083b763cea4b46c4d73027845ecc33286c157e6d564"
Sep 20 01:20:12.581626 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:12.581593    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:13.272704 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:13.272674    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:14.235080 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:14.235039    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:14.879582 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:14.879548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:14.995252 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:14.995216    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:15.091286 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.091248    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:15.155667 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.155543    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"]
Sep 20 01:20:15.157936 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.157904    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:15.158071 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.158038    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e6d769-4sjln"]
Sep 20 01:20:15.213780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.213746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:15.510086 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.510052    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff166445-27eb-484b-9341-91744fe3351e" path="/var/lib/kubelet/pods/ff166445-27eb-484b-9341-91744fe3351e/volumes"
Sep 20 01:20:15.514939 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.514914    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:15.615924 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:15.615892    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:16.309454 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:16.309421    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:17.029052 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:17.029016    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:17.931304 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:17.931275    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:18.607634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:18.607598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:19.694722 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:19.694681    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:20:21.346920 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:21.346884    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:21.407391 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:21.407361    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:21.581724 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:21.581693    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"]
Sep 20 01:20:21.581970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:21.581944    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy" containerID="cri-o://a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8" gracePeriod=30
Sep 20 01:20:21.598066 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:21.597993    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:23.011209 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:23.011148    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 01:20:23.011595 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:23.011246    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 01:20:25.331954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:25.331916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:26.215797 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.215719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:26.842963 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.842901    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:20:26.868851 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.868819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:26.934559 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934533    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-data\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934582    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-credential-socket\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934637    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-certs\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934666    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-envoy\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934720    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-token\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934747    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-socket\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934773    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-podinfo\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934802    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk7dj\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-kube-api-access-wk7dj\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934815    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:20:26.934954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934829    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02f228a-3e14-451d-9654-5dbd1b5104b9-istiod-ca-cert\") pod \"b02f228a-3e14-451d-9654-5dbd1b5104b9\" (UID: \"b02f228a-3e14-451d-9654-5dbd1b5104b9\") "
Sep 20 01:20:26.934954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934912    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:20:26.934954 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.934933    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:20:26.935477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.935349    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:26.935477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.935376    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:26.935477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.935378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:20:26.935477 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.935392    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:26.935700 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.935615    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b02f228a-3e14-451d-9654-5dbd1b5104b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:26.937812 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.937786    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:20:26.937919 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.937781    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:26.937919 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.937810    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-kube-api-access-wk7dj" (OuterVolumeSpecName: "kube-api-access-wk7dj") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "kube-api-access-wk7dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:26.937919 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:26.937845    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b02f228a-3e14-451d-9654-5dbd1b5104b9" (UID: "b02f228a-3e14-451d-9654-5dbd1b5104b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:20:27.036143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.036115    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:27.036143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.036139    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:27.036143 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.036148    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b02f228a-3e14-451d-9654-5dbd1b5104b9-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:27.036379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.036158    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b02f228a-3e14-451d-9654-5dbd1b5104b9-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:27.036379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.036167    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk7dj\" (UniqueName: \"kubernetes.io/projected/b02f228a-3e14-451d-9654-5dbd1b5104b9-kube-api-access-wk7dj\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:27.036379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.036176    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b02f228a-3e14-451d-9654-5dbd1b5104b9-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:20:27.279554 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.279519    2571 generic.go:356] "Generic (PLEG): container finished" podID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerID="a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8" exitCode=0
Sep 20 01:20:27.279741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.279568    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"
Sep 20 01:20:27.279741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.279599    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" event={"ID":"b02f228a-3e14-451d-9654-5dbd1b5104b9","Type":"ContainerDied","Data":"a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8"}
Sep 20 01:20:27.279741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.279653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk" event={"ID":"b02f228a-3e14-451d-9654-5dbd1b5104b9","Type":"ContainerDied","Data":"4d37802f435d021a9fc6546c58b618f0886bfde69589354184e0acf5a2c63338"}
Sep 20 01:20:27.279741 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.279677    2571 scope.go:117] "RemoveContainer" containerID="a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8"
Sep 20 01:20:27.289761 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.289735    2571 scope.go:117] "RemoveContainer" containerID="bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc"
Sep 20 01:20:27.297729 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.297711    2571 scope.go:117] "RemoveContainer" containerID="a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8"
Sep 20 01:20:27.297990 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:20:27.297972    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8\": container with ID starting with a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8 not found: ID does not exist" containerID="a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8"
Sep 20 01:20:27.298049 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.297998    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8"} err="failed to get container status \"a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8\": rpc error: code = NotFound desc = could not find container \"a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8\": container with ID starting with a0f241911f1a410aaed802550f44f4230a54df3a34f240f64f8b64233c5d7bb8 not found: ID does not exist"
Sep 20 01:20:27.298049 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.298014    2571 scope.go:117] "RemoveContainer" containerID="bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc"
Sep 20 01:20:27.298799 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:20:27.298782    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc\": container with ID starting with bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc not found: ID does not exist" containerID="bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc"
Sep 20 01:20:27.298860 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.298803    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc"} err="failed to get container status \"bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc\": rpc error: code = NotFound desc = could not find container \"bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc\": container with ID starting with bb5960ff387f9ce3ec3e29e7766b70b652b77da1fa7bef009e0e6972f442bbcc not found: ID does not exist"
Sep 20 01:20:27.302994 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.302970    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"]
Sep 20 01:20:27.306675 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.306653    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk"]
Sep 20 01:20:27.509453 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.509420    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" path="/var/lib/kubelet/pods/b02f228a-3e14-451d-9654-5dbd1b5104b9/volumes"
Sep 20 01:20:27.541673 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:27.541589    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:28.270420 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:28.270379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:28.995748 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:28.995712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:33.829694 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:33.829662    2571 scope.go:117] "RemoveContainer" containerID="cae7d8a0e4af64767ed6b39dd012cbdd5310d202f03cba08f51a4d928d186c21"
Sep 20 01:20:38.295053 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:38.295018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:20:38.884583 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:38.884544    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:40.592989 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:40.592952    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:40.689258 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:40.689218    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:40.740969 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:40.740933    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:40.841458 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:40.841395    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:40.943773 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:40.943692    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:41.206160 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:41.206070    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:41.315799 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:41.315760    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:42.142963 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:42.142929    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:42.815790 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:42.815742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:43.624558 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:43.624517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:46.188442 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:46.188403    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"]
Sep 20 01:20:46.231662 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:46.231629    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:20:51.993121 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:20:51.993081    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:21:01.207613 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.207567    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr" podUID="98a538ba-d3e0-44db-a8b0-c6b831df9148" containerName="main" containerID="cri-o://c128fa33c8db4848dc38821a6d5196d60c180bd1de266a8a127e5d303b6b81a7" gracePeriod=45
Sep 20 01:21:01.452364 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.452331    2571 generic.go:356] "Generic (PLEG): container finished" podID="98a538ba-d3e0-44db-a8b0-c6b831df9148" containerID="c128fa33c8db4848dc38821a6d5196d60c180bd1de266a8a127e5d303b6b81a7" exitCode=0
Sep 20 01:21:01.452486 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.452383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr" event={"ID":"98a538ba-d3e0-44db-a8b0-c6b831df9148","Type":"ContainerDied","Data":"c128fa33c8db4848dc38821a6d5196d60c180bd1de266a8a127e5d303b6b81a7"}
Sep 20 01:21:01.452486 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.452429    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr" event={"ID":"98a538ba-d3e0-44db-a8b0-c6b831df9148","Type":"ContainerDied","Data":"180843812b3a5371f7ee2979b5655ff9eb93f8ff04922766855def7873820723"}
Sep 20 01:21:01.452486 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.452445    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="180843812b3a5371f7ee2979b5655ff9eb93f8ff04922766855def7873820723"
Sep 20 01:21:01.459380 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.459334    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:21:01.540273 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540242    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-dshm\") pod \"98a538ba-d3e0-44db-a8b0-c6b831df9148\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") "
Sep 20 01:21:01.540427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540291    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjqjk\" (UniqueName: \"kubernetes.io/projected/98a538ba-d3e0-44db-a8b0-c6b831df9148-kube-api-access-tjqjk\") pod \"98a538ba-d3e0-44db-a8b0-c6b831df9148\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") "
Sep 20 01:21:01.540427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540326    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-home\") pod \"98a538ba-d3e0-44db-a8b0-c6b831df9148\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") "
Sep 20 01:21:01.540427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540396    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-tmp-dir\") pod \"98a538ba-d3e0-44db-a8b0-c6b831df9148\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") "
Sep 20 01:21:01.540605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540492    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a538ba-d3e0-44db-a8b0-c6b831df9148-tls-certs\") pod \"98a538ba-d3e0-44db-a8b0-c6b831df9148\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") "
Sep 20 01:21:01.540605 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540534    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-model-cache\") pod \"98a538ba-d3e0-44db-a8b0-c6b831df9148\" (UID: \"98a538ba-d3e0-44db-a8b0-c6b831df9148\") "
Sep 20 01:21:01.540732 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540682    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-home" (OuterVolumeSpecName: "home") pod "98a538ba-d3e0-44db-a8b0-c6b831df9148" (UID: "98a538ba-d3e0-44db-a8b0-c6b831df9148"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:01.540804 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540760    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "98a538ba-d3e0-44db-a8b0-c6b831df9148" (UID: "98a538ba-d3e0-44db-a8b0-c6b831df9148"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:01.540931 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540907    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:01.541059 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540932    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:01.541059 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.540910    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-model-cache" (OuterVolumeSpecName: "model-cache") pod "98a538ba-d3e0-44db-a8b0-c6b831df9148" (UID: "98a538ba-d3e0-44db-a8b0-c6b831df9148"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:01.542581 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.542559    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-dshm" (OuterVolumeSpecName: "dshm") pod "98a538ba-d3e0-44db-a8b0-c6b831df9148" (UID: "98a538ba-d3e0-44db-a8b0-c6b831df9148"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:01.542712 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.542585    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a538ba-d3e0-44db-a8b0-c6b831df9148-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "98a538ba-d3e0-44db-a8b0-c6b831df9148" (UID: "98a538ba-d3e0-44db-a8b0-c6b831df9148"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:21:01.542712 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.542640    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a538ba-d3e0-44db-a8b0-c6b831df9148-kube-api-access-tjqjk" (OuterVolumeSpecName: "kube-api-access-tjqjk") pod "98a538ba-d3e0-44db-a8b0-c6b831df9148" (UID: "98a538ba-d3e0-44db-a8b0-c6b831df9148"). InnerVolumeSpecName "kube-api-access-tjqjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:01.641720 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.641693    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a538ba-d3e0-44db-a8b0-c6b831df9148-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:01.641720 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.641717    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:01.641720 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.641725    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a538ba-d3e0-44db-a8b0-c6b831df9148-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:01.641930 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:01.641734    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjqjk\" (UniqueName: \"kubernetes.io/projected/98a538ba-d3e0-44db-a8b0-c6b831df9148-kube-api-access-tjqjk\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:02.457436 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:02.457403    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"
Sep 20 01:21:02.478709 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:02.478681    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"]
Sep 20 01:21:02.482233 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:02.482210    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-e458de/ipp-route-e458de-kserve-7b7bbbcb4c-t8pnr"]
Sep 20 01:21:03.509011 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:03.508977    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98a538ba-d3e0-44db-a8b0-c6b831df9148" path="/var/lib/kubelet/pods/98a538ba-d3e0-44db-a8b0-c6b831df9148/volumes"
Sep 20 01:21:22.414758 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:22.414725    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:23.231004 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:23.230968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:28.632335 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:28.632299    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:28.732971 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:28.732934    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:28.914634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:28.914554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:29.445327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:29.445286    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:30.294596 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:30.294558    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:31.019021 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:31.018980    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:31.951781 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:31.951751    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:32.646651 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:32.646597    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:33.630046 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:33.630018    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:39.862085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:39.862047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:39.925505 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:39.925471    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:40.035289 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:40.035250    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:40.108433 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:40.108393    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:40.412011 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:40.411976    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:40.523895 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:40.523863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:41.124038 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:41.124008    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:41.829168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:41.829133    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:43.593273 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:43.593240    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:21:46.449127 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:46.449088    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:46.548925 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:46.548893    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:46.650255 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:46.650224    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:47.326410 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:47.326373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:48.112024 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:48.111973    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:48.801319 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:48.801275    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:49.547022 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:49.546983    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:57.482810 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.482765    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:57.515765 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.515736    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"]
Sep 20 01:21:57.516006 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.515975    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q" podUID="264cc2e1-a9d3-4ef5-9181-74e98c6a8519" containerName="payload-processing" containerID="cri-o://18e09634a107ea5b45e7ebe84b85eab209f515e9c2635daa6178e0395228520c" gracePeriod=30
Sep 20 01:21:57.525103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.524337    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"]
Sep 20 01:21:57.525103 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.524551    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848" podUID="2214e248-39f1-4be7-b895-85547a4a1e67" containerName="payload-pre-processing" containerID="cri-o://7cd7afc0f5b170b3521dffa335e6dba03eb081a298fdf41e7777e6d6b8ad9343" gracePeriod=30
Sep 20 01:21:57.582079 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.582039    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:57.682842 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.682802    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:57.723021 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.722972    2571 generic.go:356] "Generic (PLEG): container finished" podID="2214e248-39f1-4be7-b895-85547a4a1e67" containerID="7cd7afc0f5b170b3521dffa335e6dba03eb081a298fdf41e7777e6d6b8ad9343" exitCode=0
Sep 20 01:21:57.723142 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.723119    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848" event={"ID":"2214e248-39f1-4be7-b895-85547a4a1e67","Type":"ContainerDied","Data":"7cd7afc0f5b170b3521dffa335e6dba03eb081a298fdf41e7777e6d6b8ad9343"}
Sep 20 01:21:57.725118 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.725092    2571 generic.go:356] "Generic (PLEG): container finished" podID="264cc2e1-a9d3-4ef5-9181-74e98c6a8519" containerID="18e09634a107ea5b45e7ebe84b85eab209f515e9c2635daa6178e0395228520c" exitCode=0
Sep 20 01:21:57.725231 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.725143    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q" event={"ID":"264cc2e1-a9d3-4ef5-9181-74e98c6a8519","Type":"ContainerDied","Data":"18e09634a107ea5b45e7ebe84b85eab209f515e9c2635daa6178e0395228520c"}
Sep 20 01:21:57.781612 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.781588    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:57.793608 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.793575    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:21:57.796633 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.796614    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:21:57.848269 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.848240    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcrhc\" (UniqueName: \"kubernetes.io/projected/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-kube-api-access-dcrhc\") pod \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") "
Sep 20 01:21:57.848436 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.848324    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-plugins-config-volume\") pod \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\" (UID: \"264cc2e1-a9d3-4ef5-9181-74e98c6a8519\") "
Sep 20 01:21:57.848436 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.848377    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwjx2\" (UniqueName: \"kubernetes.io/projected/2214e248-39f1-4be7-b895-85547a4a1e67-kube-api-access-zwjx2\") pod \"2214e248-39f1-4be7-b895-85547a4a1e67\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") "
Sep 20 01:21:57.848436 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.848405    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2214e248-39f1-4be7-b895-85547a4a1e67-plugins-config-volume\") pod \"2214e248-39f1-4be7-b895-85547a4a1e67\" (UID: \"2214e248-39f1-4be7-b895-85547a4a1e67\") "
Sep 20 01:21:57.848875 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.848830    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "264cc2e1-a9d3-4ef5-9181-74e98c6a8519" (UID: "264cc2e1-a9d3-4ef5-9181-74e98c6a8519"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:57.848875 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.848861    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2214e248-39f1-4be7-b895-85547a4a1e67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2214e248-39f1-4be7-b895-85547a4a1e67" (UID: "2214e248-39f1-4be7-b895-85547a4a1e67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:57.850528 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.850503    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-kube-api-access-dcrhc" (OuterVolumeSpecName: "kube-api-access-dcrhc") pod "264cc2e1-a9d3-4ef5-9181-74e98c6a8519" (UID: "264cc2e1-a9d3-4ef5-9181-74e98c6a8519"). InnerVolumeSpecName "kube-api-access-dcrhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:57.850627 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.850532    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2214e248-39f1-4be7-b895-85547a4a1e67-kube-api-access-zwjx2" (OuterVolumeSpecName: "kube-api-access-zwjx2") pod "2214e248-39f1-4be7-b895-85547a4a1e67" (UID: "2214e248-39f1-4be7-b895-85547a4a1e67"). InnerVolumeSpecName "kube-api-access-zwjx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:57.949455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.949420    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:57.949455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.949447    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwjx2\" (UniqueName: \"kubernetes.io/projected/2214e248-39f1-4be7-b895-85547a4a1e67-kube-api-access-zwjx2\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:57.949455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.949456    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2214e248-39f1-4be7-b895-85547a4a1e67-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:57.949455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:57.949464    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcrhc\" (UniqueName: \"kubernetes.io/projected/264cc2e1-a9d3-4ef5-9181-74e98c6a8519-kube-api-access-dcrhc\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:21:58.051951 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.051868    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:58.153615 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.153585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:58.730437 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.730404    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"
Sep 20 01:21:58.730896 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.730436    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848" event={"ID":"2214e248-39f1-4be7-b895-85547a4a1e67","Type":"ContainerDied","Data":"2d51e022c11ad07d3e30d63957e8783bcb131c391c0cd4783c4c9707c9b23fb6"}
Sep 20 01:21:58.730896 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.730512    2571 scope.go:117] "RemoveContainer" containerID="7cd7afc0f5b170b3521dffa335e6dba03eb081a298fdf41e7777e6d6b8ad9343"
Sep 20 01:21:58.731891 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.731873    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"
Sep 20 01:21:58.731987 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.731899    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q" event={"ID":"264cc2e1-a9d3-4ef5-9181-74e98c6a8519","Type":"ContainerDied","Data":"ae60ec05b11eb1d0e305438672901c68f163729d3957c8c93df4c701de65acfc"}
Sep 20 01:21:58.741099 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.741082    2571 scope.go:117] "RemoveContainer" containerID="18e09634a107ea5b45e7ebe84b85eab209f515e9c2635daa6178e0395228520c"
Sep 20 01:21:58.753010 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.752988    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"]
Sep 20 01:21:58.756829 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.756809    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848"]
Sep 20 01:21:58.766284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.766261    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"]
Sep 20 01:21:58.774809 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.774788    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q"]
Sep 20 01:21:58.828960 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:58.828933    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:21:59.508379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:59.508346    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2214e248-39f1-4be7-b895-85547a4a1e67" path="/var/lib/kubelet/pods/2214e248-39f1-4be7-b895-85547a4a1e67/volumes"
Sep 20 01:21:59.508742 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:21:59.508729    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264cc2e1-a9d3-4ef5-9181-74e98c6a8519" path="/var/lib/kubelet/pods/264cc2e1-a9d3-4ef5-9181-74e98c6a8519/volumes"
Sep 20 01:22:00.594970 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:00.594937    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:22:03.735009 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:03.734975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:03.830845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:03.830815    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:03.965548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:03.965511    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"]
Sep 20 01:22:03.965795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:03.965768    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy" containerID="cri-o://8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e" gracePeriod=30
Sep 20 01:22:03.984873 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:03.984837    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:04.710901 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:04.710865    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:05.337525 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:05.337492    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:06.017573 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:06.017532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:09.218824 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.218798    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:22:09.349554 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349522    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-certs\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349554 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349554    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-credential-socket\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349593    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-envoy\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349614    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-token\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349641    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gsnb\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-kube-api-access-5gsnb\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349662    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-socket\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349702    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istiod-ca-cert\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349737    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-data\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.349819 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349761    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-podinfo\") pod \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\" (UID: \"9c928423-1eb8-4cbc-a040-2cd1e6720c86\") "
Sep 20 01:22:09.350181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349847    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:09.350181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.349878    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:09.350181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.350071    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:09.350181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.350091    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:22:09.350181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.350149    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.350181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.350167    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-credential-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.350181 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.350168    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:09.351962 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.351937    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-kube-api-access-5gsnb" (OuterVolumeSpecName: "kube-api-access-5gsnb") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "kube-api-access-5gsnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:09.352085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.352004    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:09.352085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.352027    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:22:09.352085 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.352038    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c928423-1eb8-4cbc-a040-2cd1e6720c86" (UID: "9c928423-1eb8-4cbc-a040-2cd1e6720c86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:09.451556 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.451527    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-envoy\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.451556 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.451552    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-token\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.451556 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.451562    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gsnb\" (UniqueName: \"kubernetes.io/projected/9c928423-1eb8-4cbc-a040-2cd1e6720c86-kube-api-access-5gsnb\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.451766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.451570    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-workload-socket\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.451766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.451578    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istiod-ca-cert\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.451766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.451587    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-data\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.451766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.451594    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c928423-1eb8-4cbc-a040-2cd1e6720c86-istio-podinfo\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:09.793501 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.793461    2571 generic.go:356] "Generic (PLEG): container finished" podID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerID="8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e" exitCode=0
Sep 20 01:22:09.793674 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.793516    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"
Sep 20 01:22:09.793674 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.793543    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" event={"ID":"9c928423-1eb8-4cbc-a040-2cd1e6720c86","Type":"ContainerDied","Data":"8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e"}
Sep 20 01:22:09.793674 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.793600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml" event={"ID":"9c928423-1eb8-4cbc-a040-2cd1e6720c86","Type":"ContainerDied","Data":"d7077197355e6f79da9ca0efccff632d3ea14aae052b2f26ca6441f21153c81b"}
Sep 20 01:22:09.793674 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.793623    2571 scope.go:117] "RemoveContainer" containerID="8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e"
Sep 20 01:22:09.802852 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.802835    2571 scope.go:117] "RemoveContainer" containerID="59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5"
Sep 20 01:22:09.811139 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.811120    2571 scope.go:117] "RemoveContainer" containerID="8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e"
Sep 20 01:22:09.811462 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:22:09.811443    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e\": container with ID starting with 8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e not found: ID does not exist" containerID="8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e"
Sep 20 01:22:09.811529 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.811471    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e"} err="failed to get container status \"8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e\": rpc error: code = NotFound desc = could not find container \"8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e\": container with ID starting with 8f0fec2820824be2ef26165d2ff9840bbecf38059b90b44b8508e5b0121c6f6e not found: ID does not exist"
Sep 20 01:22:09.811529 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.811500    2571 scope.go:117] "RemoveContainer" containerID="59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5"
Sep 20 01:22:09.811639 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.811601    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"]
Sep 20 01:22:09.811803 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:22:09.811784    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5\": container with ID starting with 59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5 not found: ID does not exist" containerID="59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5"
Sep 20 01:22:09.811850 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.811814    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5"} err="failed to get container status \"59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5\": rpc error: code = NotFound desc = could not find container \"59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5\": container with ID starting with 59cdcb562bcfa7c2479db59c0adeed7c19f017f2a9e21e42609c7e1463befff5 not found: ID does not exist"
Sep 20 01:22:09.814795 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:09.814774    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml"]
Sep 20 01:22:11.508845 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:11.508811    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" path="/var/lib/kubelet/pods/9c928423-1eb8-4cbc-a040-2cd1e6720c86/volumes"
Sep 20 01:22:14.863951 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.863907    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"]
Sep 20 01:22:14.864682 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.863995    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:14.866629 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.866604    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c93ee-29831115-95lsl"]
Sep 20 01:22:14.899327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.899296    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"]
Sep 20 01:22:14.899520 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.899494    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm" podUID="1b660953-d498-44d8-91cd-71677e75fcfb" containerName="payload-processing" containerID="cri-o://abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b" gracePeriod=30
Sep 20 01:22:14.906475 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.906447    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"]
Sep 20 01:22:14.906744 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.906690    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2" podUID="6d078c0f-02e6-4062-8b8b-9a33ed322085" containerName="payload-pre-processing" containerID="cri-o://9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7" gracePeriod=30
Sep 20 01:22:14.927135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.927104    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:14.986818 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:14.986787    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:15.062867 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.062819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:15.121123 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.121032    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:15.177672 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.177650    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:22:15.180589 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.180567    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:22:15.303310 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.303278    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8dqh\" (UniqueName: \"kubernetes.io/projected/1b660953-d498-44d8-91cd-71677e75fcfb-kube-api-access-p8dqh\") pod \"1b660953-d498-44d8-91cd-71677e75fcfb\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") "
Sep 20 01:22:15.303488 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.303331    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b660953-d498-44d8-91cd-71677e75fcfb-plugins-config-volume\") pod \"1b660953-d498-44d8-91cd-71677e75fcfb\" (UID: \"1b660953-d498-44d8-91cd-71677e75fcfb\") "
Sep 20 01:22:15.303488 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.303364    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kssg9\" (UniqueName: \"kubernetes.io/projected/6d078c0f-02e6-4062-8b8b-9a33ed322085-kube-api-access-kssg9\") pod \"6d078c0f-02e6-4062-8b8b-9a33ed322085\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") "
Sep 20 01:22:15.303488 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.303402    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d078c0f-02e6-4062-8b8b-9a33ed322085-plugins-config-volume\") pod \"6d078c0f-02e6-4062-8b8b-9a33ed322085\" (UID: \"6d078c0f-02e6-4062-8b8b-9a33ed322085\") "
Sep 20 01:22:15.303756 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.303728    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b660953-d498-44d8-91cd-71677e75fcfb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b660953-d498-44d8-91cd-71677e75fcfb" (UID: "1b660953-d498-44d8-91cd-71677e75fcfb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:22:15.303902 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.303838    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d078c0f-02e6-4062-8b8b-9a33ed322085-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d078c0f-02e6-4062-8b8b-9a33ed322085" (UID: "6d078c0f-02e6-4062-8b8b-9a33ed322085"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:22:15.305478 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.305459    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b660953-d498-44d8-91cd-71677e75fcfb-kube-api-access-p8dqh" (OuterVolumeSpecName: "kube-api-access-p8dqh") pod "1b660953-d498-44d8-91cd-71677e75fcfb" (UID: "1b660953-d498-44d8-91cd-71677e75fcfb"). InnerVolumeSpecName "kube-api-access-p8dqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:15.305539 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.305510    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d078c0f-02e6-4062-8b8b-9a33ed322085-kube-api-access-kssg9" (OuterVolumeSpecName: "kube-api-access-kssg9") pod "6d078c0f-02e6-4062-8b8b-9a33ed322085" (UID: "6d078c0f-02e6-4062-8b8b-9a33ed322085"). InnerVolumeSpecName "kube-api-access-kssg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:15.404357 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.404291    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d078c0f-02e6-4062-8b8b-9a33ed322085-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.404357 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.404314    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8dqh\" (UniqueName: \"kubernetes.io/projected/1b660953-d498-44d8-91cd-71677e75fcfb-kube-api-access-p8dqh\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.404357 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.404327    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b660953-d498-44d8-91cd-71677e75fcfb-plugins-config-volume\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.404357 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.404337    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kssg9\" (UniqueName: \"kubernetes.io/projected/6d078c0f-02e6-4062-8b8b-9a33ed322085-kube-api-access-kssg9\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:22:15.430863 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.430829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:15.508399 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.508363    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5927ba3-28e9-4052-9a1f-75a1795462c5" path="/var/lib/kubelet/pods/f5927ba3-28e9-4052-9a1f-75a1795462c5/volumes"
Sep 20 01:22:15.538284 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.538243    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:15.823883 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.823842    2571 generic.go:356] "Generic (PLEG): container finished" podID="1b660953-d498-44d8-91cd-71677e75fcfb" containerID="abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b" exitCode=0
Sep 20 01:22:15.823883 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.823879    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"
Sep 20 01:22:15.824114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.823886    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm" event={"ID":"1b660953-d498-44d8-91cd-71677e75fcfb","Type":"ContainerDied","Data":"abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b"}
Sep 20 01:22:15.824114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.823942    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm" event={"ID":"1b660953-d498-44d8-91cd-71677e75fcfb","Type":"ContainerDied","Data":"ec28d6ec1c42d7238d2e528a80b3d30a1bee635478c8e2467687a46325bcd80e"}
Sep 20 01:22:15.824114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.823973    2571 scope.go:117] "RemoveContainer" containerID="abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b"
Sep 20 01:22:15.825455 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.825428    2571 generic.go:356] "Generic (PLEG): container finished" podID="6d078c0f-02e6-4062-8b8b-9a33ed322085" containerID="9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7" exitCode=0
Sep 20 01:22:15.825603 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.825466    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"
Sep 20 01:22:15.825603 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.825527    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2" event={"ID":"6d078c0f-02e6-4062-8b8b-9a33ed322085","Type":"ContainerDied","Data":"9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7"}
Sep 20 01:22:15.825603 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.825572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2" event={"ID":"6d078c0f-02e6-4062-8b8b-9a33ed322085","Type":"ContainerDied","Data":"17e7c48777095935bad5a85ec0a26d1fd76774af069acf7f3976947901b6b493"}
Sep 20 01:22:15.832729 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.832714    2571 scope.go:117] "RemoveContainer" containerID="abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b"
Sep 20 01:22:15.832998 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:22:15.832979    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b\": container with ID starting with abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b not found: ID does not exist" containerID="abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b"
Sep 20 01:22:15.833052 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.833006    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b"} err="failed to get container status \"abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b\": rpc error: code = NotFound desc = could not find container \"abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b\": container with ID starting with abb723d6ab8cfb31f1afae37932a3e982108053a8d48f3e3938dc452bbc2f29b not found: ID does not exist"
Sep 20 01:22:15.833052 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.833024    2571 scope.go:117] "RemoveContainer" containerID="9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7"
Sep 20 01:22:15.840472 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.840451    2571 scope.go:117] "RemoveContainer" containerID="9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7"
Sep 20 01:22:15.840729 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:22:15.840708    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7\": container with ID starting with 9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7 not found: ID does not exist" containerID="9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7"
Sep 20 01:22:15.840776 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.840737    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7"} err="failed to get container status \"9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7\": rpc error: code = NotFound desc = could not find container \"9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7\": container with ID starting with 9aab4be51a0a00a29846a36b94102a9d8a7abbfd1e44750a82c2cfd9b1aa6bb7 not found: ID does not exist"
Sep 20 01:22:15.843543 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.843517    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"]
Sep 20 01:22:15.844924 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.844904    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2"]
Sep 20 01:22:15.857262 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.857236    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"]
Sep 20 01:22:15.861459 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:15.861436    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm"]
Sep 20 01:22:17.508162 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:17.508125    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b660953-d498-44d8-91cd-71677e75fcfb" path="/var/lib/kubelet/pods/1b660953-d498-44d8-91cd-71677e75fcfb/volumes"
Sep 20 01:22:17.508722 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:17.508701    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d078c0f-02e6-4062-8b8b-9a33ed322085" path="/var/lib/kubelet/pods/6d078c0f-02e6-4062-8b8b-9a33ed322085/volumes"
Sep 20 01:22:17.693012 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:17.692978    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:22:21.363015 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:21.362980    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:21.433625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:21.433590    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:21.605225 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:21.605179    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:22:25.795041 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:25.795006    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:22:33.860716 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:33.860681    2571 scope.go:117] "RemoveContainer" containerID="53ff1de37184f1af05843b908fff9d333e5907cb8c6cabba89814dfa57f66535"
Sep 20 01:22:46.700959 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:22:46.700899    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:23:24.098140 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:23:24.098094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:23:34.720653 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:23:34.720561    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:23:45.664503 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:23:45.664466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:23:46.290514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:23:46.290476    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:23:47.514780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:23:47.514738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:24:25.893776 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:24:25.893737    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:24:33.898462 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:24:33.898428    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:24:41.101342 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:24:41.101306    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:24:48.194804 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:24:48.194763    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:25:02.594691 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:25:02.594655    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:25:10.690712 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:25:10.690676    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:25:33.910014 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:25:33.909981    2571 scope.go:117] "RemoveContainer" containerID="c128fa33c8db4848dc38821a6d5196d60c180bd1de266a8a127e5d303b6b81a7"
Sep 20 01:26:29.470089 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:29.470056    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:26:33.932115 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:33.932082    2571 scope.go:117] "RemoveContainer" containerID="3cfa50591cfbdd82fa34ee86b874382d58ffeaae6b38136574c77e479ce7348a"
Sep 20 01:26:38.501068 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:38.501026    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:26:46.700796 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:46.700758    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:26:51.379952 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.379915    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"]
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380274    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d078c0f-02e6-4062-8b8b-9a33ed322085" containerName="payload-pre-processing"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380287    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d078c0f-02e6-4062-8b8b-9a33ed322085" containerName="payload-pre-processing"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380302    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b660953-d498-44d8-91cd-71677e75fcfb" containerName="payload-processing"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380308    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b660953-d498-44d8-91cd-71677e75fcfb" containerName="payload-processing"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380314    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a538ba-d3e0-44db-a8b0-c6b831df9148" containerName="main"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380321    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a538ba-d3e0-44db-a8b0-c6b831df9148" containerName="main"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380327    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380334    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380346    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380352    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380361    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264cc2e1-a9d3-4ef5-9181-74e98c6a8519" containerName="payload-processing"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380366    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="264cc2e1-a9d3-4ef5-9181-74e98c6a8519" containerName="payload-processing"
Sep 20 01:26:51.380371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380375    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff166445-27eb-484b-9341-91744fe3351e" containerName="revoke-keys"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380380    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff166445-27eb-484b-9341-91744fe3351e" containerName="revoke-keys"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380386    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2214e248-39f1-4be7-b895-85547a4a1e67" containerName="payload-pre-processing"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380391    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2214e248-39f1-4be7-b895-85547a4a1e67" containerName="payload-pre-processing"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380398    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380403    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380450    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d078c0f-02e6-4062-8b8b-9a33ed322085" containerName="payload-pre-processing"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380457    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380462    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff166445-27eb-484b-9341-91744fe3351e" containerName="revoke-keys"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380467    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2214e248-39f1-4be7-b895-85547a4a1e67" containerName="payload-pre-processing"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380474    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a538ba-d3e0-44db-a8b0-c6b831df9148" containerName="main"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380479    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b660953-d498-44d8-91cd-71677e75fcfb" containerName="payload-processing"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380486    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c928423-1eb8-4cbc-a040-2cd1e6720c86" containerName="istio-proxy"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380493    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="264cc2e1-a9d3-4ef5-9181-74e98c6a8519" containerName="payload-processing"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380499    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy"
Sep 20 01:26:51.380774 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.380505    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy"
Sep 20 01:26:51.383086 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.383070    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.385517 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.385494    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-6a428c11-kserve-self-signed-certs\""
Sep 20 01:26:51.390637 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.390610    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"]
Sep 20 01:26:51.479982 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.479947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-dshm\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.480168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.480001    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-home\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.480168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.480018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-tmp-dir\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.480168 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.480131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e812b857-256d-446c-9390-c47e793c2069-tls-certs\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.480327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.480171    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvr6\" (UniqueName: \"kubernetes.io/projected/e812b857-256d-446c-9390-c47e793c2069-kube-api-access-cvvr6\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.480327 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.480247    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-model-cache\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.580689 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.580657    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-dshm\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.580983 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.580962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-home\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.581235 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.581210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-tmp-dir\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.581425 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.581407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e812b857-256d-446c-9390-c47e793c2069-tls-certs\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.581514 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.581496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvr6\" (UniqueName: \"kubernetes.io/projected/e812b857-256d-446c-9390-c47e793c2069-kube-api-access-cvvr6\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.581575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.581545    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-tmp-dir\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.581575 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.581567    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-home\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.581889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.581866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-model-cache\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.582348 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.582315    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-model-cache\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.582982 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.582962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-dshm\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.584125 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.584103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e812b857-256d-446c-9390-c47e793c2069-tls-certs\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.589008 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.588989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvr6\" (UniqueName: \"kubernetes.io/projected/e812b857-256d-446c-9390-c47e793c2069-kube-api-access-cvvr6\") pod \"e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") " pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.687559 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.687481    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:26:51.692397 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.692375    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:26:51.964363 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:51.964338    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"]
Sep 20 01:26:51.967034 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:26:51.967011    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode812b857_256d_446c_9390_c47e793c2069.slice/crio-86d356c6dd28a3a5641649c522dd8aee2c464c70f3fbf8e8bb36ca0a5693eac0 WatchSource:0}: Error finding container 86d356c6dd28a3a5641649c522dd8aee2c464c70f3fbf8e8bb36ca0a5693eac0: Status 404 returned error can't find the container with id 86d356c6dd28a3a5641649c522dd8aee2c464c70f3fbf8e8bb36ca0a5693eac0
Sep 20 01:26:52.054236 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:52.054178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw" event={"ID":"e812b857-256d-446c-9390-c47e793c2069","Type":"ContainerStarted","Data":"331e32f1b06bf8d8e69e16a627cf97b9ec0694a1eae0b3d96286e8f2339fb7f5"}
Sep 20 01:26:52.054360 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:52.054254    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw" event={"ID":"e812b857-256d-446c-9390-c47e793c2069","Type":"ContainerStarted","Data":"86d356c6dd28a3a5641649c522dd8aee2c464c70f3fbf8e8bb36ca0a5693eac0"}
Sep 20 01:26:52.069976 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:52.069927    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw" podStartSLOduration=1.069907123 podStartE2EDuration="1.069907123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:26:52.069064566 +0000 UTC m=+2359.062340100" watchObservedRunningTime="2026-09-20 01:26:52.069907123 +0000 UTC m=+2359.063182656"
Sep 20 01:26:55.309171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.309130    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:26:55.891924 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.891886    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"]
Sep 20 01:26:55.892395 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.892372    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy"
Sep 20 01:26:55.892395 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.892397    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02f228a-3e14-451d-9654-5dbd1b5104b9" containerName="istio-proxy"
Sep 20 01:26:55.895733 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.895715    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:55.898307 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.898274    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-6a428c11-kserve-self-signed-certs\""
Sep 20 01:26:55.905973 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.905945    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"]
Sep 20 01:26:55.925707 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:55.925676    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:26:56.025365 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.025329    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z697\" (UniqueName: \"kubernetes.io/projected/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-kube-api-access-8z697\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.025548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.025400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-model-cache\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.025548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.025455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tls-certs\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.025548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.025492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-home\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.025548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.025508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-dshm\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.025752 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.025610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tmp-dir\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tmp-dir\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z697\" (UniqueName: \"kubernetes.io/projected/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-kube-api-access-8z697\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-model-cache\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tls-certs\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126287    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-home\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126344 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-dshm\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126592 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tmp-dir\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126652 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126607    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-model-cache\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.126709 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.126658    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-home\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.128571 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.128549    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-dshm\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.128782 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.128763    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tls-certs\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.134256 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.134235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z697\" (UniqueName: \"kubernetes.io/projected/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-kube-api-access-8z697\") pod \"e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") " pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.206889 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.206793    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:26:56.482545 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:56.482464    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"]
Sep 20 01:26:56.484753 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:26:56.484719    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3d12b7a_33c6_40da_b40a_be4fce7e9e58.slice/crio-b95dc9e0eeaacc78e1bfc82a689e00f54586cb42fe5295d50f26410be9737a62 WatchSource:0}: Error finding container b95dc9e0eeaacc78e1bfc82a689e00f54586cb42fe5295d50f26410be9737a62: Status 404 returned error can't find the container with id b95dc9e0eeaacc78e1bfc82a689e00f54586cb42fe5295d50f26410be9737a62
Sep 20 01:26:57.078734 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:57.078695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr" event={"ID":"c3d12b7a-33c6-40da-b40a-be4fce7e9e58","Type":"ContainerStarted","Data":"23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1"}
Sep 20 01:26:57.078908 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:57.078750    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr" event={"ID":"c3d12b7a-33c6-40da-b40a-be4fce7e9e58","Type":"ContainerStarted","Data":"b95dc9e0eeaacc78e1bfc82a689e00f54586cb42fe5295d50f26410be9737a62"}
Sep 20 01:26:57.096721 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:26:57.096629    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr" podStartSLOduration=2.096607891 podStartE2EDuration="2.096607891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:26:57.094517146 +0000 UTC m=+2364.087792681" watchObservedRunningTime="2026-09-20 01:26:57.096607891 +0000 UTC m=+2364.089883425"
Sep 20 01:27:01.692945 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:01.692890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:27:01.693519 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:01.692963    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:27:01.705520 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:01.705494    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:27:02.110133 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:02.110103    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:27:04.501852 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:04.501814    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:27:06.207313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:06.207277    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:27:06.207313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:06.207323    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:27:06.220028 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:06.220006    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:27:07.131951 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:07.131919    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:27:19.647852 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:19.647807    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:27:19.708647 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:19.708610    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:27:26.066859 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:26.066820    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"]
Sep 20 01:27:26.085336 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:26.085302    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:27:27.909371 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:27.909333    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"]
Sep 20 01:27:27.953780 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:27.953746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:27:28.294238 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:28.294203    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:27:36.996931 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:36.996893    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:27:41.086508 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.086464    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw" podUID="e812b857-256d-446c-9390-c47e793c2069" containerName="main" containerID="cri-o://331e32f1b06bf8d8e69e16a627cf97b9ec0694a1eae0b3d96286e8f2339fb7f5" gracePeriod=45
Sep 20 01:27:41.279594 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.279548    2571 generic.go:356] "Generic (PLEG): container finished" podID="e812b857-256d-446c-9390-c47e793c2069" containerID="331e32f1b06bf8d8e69e16a627cf97b9ec0694a1eae0b3d96286e8f2339fb7f5" exitCode=0
Sep 20 01:27:41.279756 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.279599    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw" event={"ID":"e812b857-256d-446c-9390-c47e793c2069","Type":"ContainerDied","Data":"331e32f1b06bf8d8e69e16a627cf97b9ec0694a1eae0b3d96286e8f2339fb7f5"}
Sep 20 01:27:41.330559 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.330532    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:27:41.433171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433102    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-model-cache\") pod \"e812b857-256d-446c-9390-c47e793c2069\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") "
Sep 20 01:27:41.433171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433134    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e812b857-256d-446c-9390-c47e793c2069-tls-certs\") pod \"e812b857-256d-446c-9390-c47e793c2069\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") "
Sep 20 01:27:41.433171 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433158    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-dshm\") pod \"e812b857-256d-446c-9390-c47e793c2069\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") "
Sep 20 01:27:41.433480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433225    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-home\") pod \"e812b857-256d-446c-9390-c47e793c2069\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") "
Sep 20 01:27:41.433480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433267    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-tmp-dir\") pod \"e812b857-256d-446c-9390-c47e793c2069\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") "
Sep 20 01:27:41.433480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433297    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvvr6\" (UniqueName: \"kubernetes.io/projected/e812b857-256d-446c-9390-c47e793c2069-kube-api-access-cvvr6\") pod \"e812b857-256d-446c-9390-c47e793c2069\" (UID: \"e812b857-256d-446c-9390-c47e793c2069\") "
Sep 20 01:27:41.433480 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433383    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-model-cache" (OuterVolumeSpecName: "model-cache") pod "e812b857-256d-446c-9390-c47e793c2069" (UID: "e812b857-256d-446c-9390-c47e793c2069"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:41.433692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433544    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e812b857-256d-446c-9390-c47e793c2069" (UID: "e812b857-256d-446c-9390-c47e793c2069"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:41.433692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433556    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-home" (OuterVolumeSpecName: "home") pod "e812b857-256d-446c-9390-c47e793c2069" (UID: "e812b857-256d-446c-9390-c47e793c2069"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:41.433692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.433615    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:41.435557 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.435530    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e812b857-256d-446c-9390-c47e793c2069-kube-api-access-cvvr6" (OuterVolumeSpecName: "kube-api-access-cvvr6") pod "e812b857-256d-446c-9390-c47e793c2069" (UID: "e812b857-256d-446c-9390-c47e793c2069"). InnerVolumeSpecName "kube-api-access-cvvr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:27:41.435557 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.435538    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e812b857-256d-446c-9390-c47e793c2069-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e812b857-256d-446c-9390-c47e793c2069" (UID: "e812b857-256d-446c-9390-c47e793c2069"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:27:41.435715 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.435576    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-dshm" (OuterVolumeSpecName: "dshm") pod "e812b857-256d-446c-9390-c47e793c2069" (UID: "e812b857-256d-446c-9390-c47e793c2069"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:41.534640 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.534609    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e812b857-256d-446c-9390-c47e793c2069-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:41.534640 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.534633    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:41.534640 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.534641    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:41.534833 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.534648    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e812b857-256d-446c-9390-c47e793c2069-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:41.534833 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:41.534656    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvvr6\" (UniqueName: \"kubernetes.io/projected/e812b857-256d-446c-9390-c47e793c2069-kube-api-access-cvvr6\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:42.287626 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:42.287586    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"
Sep 20 01:27:42.287626 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:42.287602    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw" event={"ID":"e812b857-256d-446c-9390-c47e793c2069","Type":"ContainerDied","Data":"86d356c6dd28a3a5641649c522dd8aee2c464c70f3fbf8e8bb36ca0a5693eac0"}
Sep 20 01:27:42.288223 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:42.287653    2571 scope.go:117] "RemoveContainer" containerID="331e32f1b06bf8d8e69e16a627cf97b9ec0694a1eae0b3d96286e8f2339fb7f5"
Sep 20 01:27:42.304908 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:42.304872    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"]
Sep 20 01:27:42.306940 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:42.306917    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-6a428c11-kserve-67879bdd75-ffvxw"]
Sep 20 01:27:42.927959 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:42.927914    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr" podUID="c3d12b7a-33c6-40da-b40a-be4fce7e9e58" containerName="main" containerID="cri-o://23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1" gracePeriod=45
Sep 20 01:27:43.173864 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.173840    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:27:43.250296 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250270    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-dshm\") pod \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") "
Sep 20 01:27:43.250435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250321    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-model-cache\") pod \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") "
Sep 20 01:27:43.250435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250363    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tls-certs\") pod \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") "
Sep 20 01:27:43.250435 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250405    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-home\") pod \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") "
Sep 20 01:27:43.250590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250453    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z697\" (UniqueName: \"kubernetes.io/projected/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-kube-api-access-8z697\") pod \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") "
Sep 20 01:27:43.250590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250487    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tmp-dir\") pod \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\" (UID: \"c3d12b7a-33c6-40da-b40a-be4fce7e9e58\") "
Sep 20 01:27:43.250590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250574    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3d12b7a-33c6-40da-b40a-be4fce7e9e58" (UID: "c3d12b7a-33c6-40da-b40a-be4fce7e9e58"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:43.250747 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250670    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-home" (OuterVolumeSpecName: "home") pod "c3d12b7a-33c6-40da-b40a-be4fce7e9e58" (UID: "c3d12b7a-33c6-40da-b40a-be4fce7e9e58"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:43.250747 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250731    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3d12b7a-33c6-40da-b40a-be4fce7e9e58" (UID: "c3d12b7a-33c6-40da-b40a-be4fce7e9e58"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:43.250858 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250821    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-home\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:43.250858 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250833    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tmp-dir\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:43.250858 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.250844    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-model-cache\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:43.252530 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.252498    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-kube-api-access-8z697" (OuterVolumeSpecName: "kube-api-access-8z697") pod "c3d12b7a-33c6-40da-b40a-be4fce7e9e58" (UID: "c3d12b7a-33c6-40da-b40a-be4fce7e9e58"). InnerVolumeSpecName "kube-api-access-8z697". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:27:43.252650 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.252554    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3d12b7a-33c6-40da-b40a-be4fce7e9e58" (UID: "c3d12b7a-33c6-40da-b40a-be4fce7e9e58"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:27:43.252696 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.252647    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-dshm" (OuterVolumeSpecName: "dshm") pod "c3d12b7a-33c6-40da-b40a-be4fce7e9e58" (UID: "c3d12b7a-33c6-40da-b40a-be4fce7e9e58"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:27:43.293886 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.293857    2571 generic.go:356] "Generic (PLEG): container finished" podID="c3d12b7a-33c6-40da-b40a-be4fce7e9e58" containerID="23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1" exitCode=0
Sep 20 01:27:43.294274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.293901    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"
Sep 20 01:27:43.294274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.293939    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr" event={"ID":"c3d12b7a-33c6-40da-b40a-be4fce7e9e58","Type":"ContainerDied","Data":"23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1"}
Sep 20 01:27:43.294274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.293984    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr" event={"ID":"c3d12b7a-33c6-40da-b40a-be4fce7e9e58","Type":"ContainerDied","Data":"b95dc9e0eeaacc78e1bfc82a689e00f54586cb42fe5295d50f26410be9737a62"}
Sep 20 01:27:43.294274 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.294005    2571 scope.go:117] "RemoveContainer" containerID="23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1"
Sep 20 01:27:43.302179 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.302118    2571 scope.go:117] "RemoveContainer" containerID="23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1"
Sep 20 01:27:43.302456 ip-10-0-134-159 kubenswrapper[2571]: E0920 01:27:43.302436    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1\": container with ID starting with 23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1 not found: ID does not exist" containerID="23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1"
Sep 20 01:27:43.302548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.302466    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1"} err="failed to get container status \"23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1\": rpc error: code = NotFound desc = could not find container \"23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1\": container with ID starting with 23206d3db3be539e30e81a97fefdbce526995a8be7629e74ad093d40b80024c1 not found: ID does not exist"
Sep 20 01:27:43.314648 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.314623    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"]
Sep 20 01:27:43.318242 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.318218    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-6a428c11-kserve-7f85c9f55-sjhnr"]
Sep 20 01:27:43.352055 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.352035    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-dshm\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:43.352147 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.352058    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-tls-certs\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:43.352147 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.352074    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z697\" (UniqueName: \"kubernetes.io/projected/c3d12b7a-33c6-40da-b40a-be4fce7e9e58-kube-api-access-8z697\") on node \"ip-10-0-134-159.ec2.internal\" DevicePath \"\""
Sep 20 01:27:43.508574 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.508498    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d12b7a-33c6-40da-b40a-be4fce7e9e58" path="/var/lib/kubelet/pods/c3d12b7a-33c6-40da-b40a-be4fce7e9e58/volumes"
Sep 20 01:27:43.508946 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:43.508930    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e812b857-256d-446c-9390-c47e793c2069" path="/var/lib/kubelet/pods/e812b857-256d-446c-9390-c47e793c2069/volumes"
Sep 20 01:27:44.103233 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:44.103187    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:27:51.314156 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:51.314114    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:27:52.088086 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:52.088047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:27:58.797759 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:27:58.797717    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:28:05.894503 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:05.894463    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:28:14.500259 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:14.500220    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:28:20.800174 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:20.800137    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8ff9d"]
Sep 20 01:28:24.045452 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:24.045415    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66cd9df6-9gvgv_94385181-f298-4c85-9dd0-5fd4ab760c5f/authorino/0.log"
Sep 20 01:28:30.099904 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:30.099869    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-psdlk_2b8b87d4-53ac-47d0-8221-5e639b223b85/manager/0.log"
Sep 20 01:28:30.105007 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:30.104987    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-psdlk_2b8b87d4-53ac-47d0-8221-5e639b223b85/copy-manifests/0.log"
Sep 20 01:28:31.639175 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:31.639143    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66cd9df6-9gvgv_94385181-f298-4c85-9dd0-5fd4ab760c5f/authorino/0.log"
Sep 20 01:28:32.260273 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:32.260240    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8ff9d_2bb07b8d-a306-49b8-8930-7e7be3bdc431/limitador/0.log"
Sep 20 01:28:32.954957 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:32.954928    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-pkc2d_66db052b-2a4d-4f34-8529-9ad9f2becf63/kube-auth-proxy/0.log"
Sep 20 01:28:33.199339 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:33.199303    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-b6lkl_2a6b5bc6-2c3f-4cf3-b25e-1064efece277/istio-proxy/1.log"
Sep 20 01:28:34.116856 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:34.116825    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-274md_c9729429-174d-47f5-bd88-2086f22674fe/main/0.log"
Sep 20 01:28:34.547211 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:34.547169    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dkh7c_54fa31cf-4610-4010-8cbe-f55b1747e0d9/main/0.log"
Sep 20 01:28:40.042824 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:40.042783    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:28:41.000368 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:41.000331    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:28:43.054204 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:43.054157    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p8hhh_89d96c9f-5938-4fae-8377-4623f781d451/global-pull-secret-syncer/0.log"
Sep 20 01:28:43.101490 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:43.101463    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log"
Sep 20 01:28:43.207879 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:43.207849    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-159.ec2.internal_fa5c61b1f5e26b2389ad9ed376a58f2d/haproxy/0.log"
Sep 20 01:28:47.534235 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:47.534188    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66cd9df6-9gvgv_94385181-f298-4c85-9dd0-5fd4ab760c5f/authorino/0.log"
Sep 20 01:28:47.707095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:47.707068    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8ff9d_2bb07b8d-a306-49b8-8930-7e7be3bdc431/limitador/0.log"
Sep 20 01:28:49.651447 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:49.651417    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pwrh_29322baf-23ee-44d7-84c6-461dfcabce0f/node-exporter/0.log"
Sep 20 01:28:49.672313 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:49.672287    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pwrh_29322baf-23ee-44d7-84c6-461dfcabce0f/kube-rbac-proxy/0.log"
Sep 20 01:28:49.691652 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:49.691629    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8pwrh_29322baf-23ee-44d7-84c6-461dfcabce0f/init-textfile/0.log"
Sep 20 01:28:49.979937 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:49.979855    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42d36068-fa61-42af-9326-2de34d2c30ba/prometheus/0.log"
Sep 20 01:28:50.012107 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:50.012081    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42d36068-fa61-42af-9326-2de34d2c30ba/config-reloader/0.log"
Sep 20 01:28:50.032679 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:50.032656    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42d36068-fa61-42af-9326-2de34d2c30ba/thanos-sidecar/0.log"
Sep 20 01:28:50.064045 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:50.064026    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42d36068-fa61-42af-9326-2de34d2c30ba/kube-rbac-proxy-web/0.log"
Sep 20 01:28:50.084797 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:50.084775    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42d36068-fa61-42af-9326-2de34d2c30ba/kube-rbac-proxy/0.log"
Sep 20 01:28:50.108159 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:50.108138    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42d36068-fa61-42af-9326-2de34d2c30ba/kube-rbac-proxy-thanos/0.log"
Sep 20 01:28:50.136576 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:50.136554    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42d36068-fa61-42af-9326-2de34d2c30ba/init-config-reloader/0.log"
Sep 20 01:28:52.083602 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:52.083574    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-ngqzr_551414d2-f883-4128-97e0-ef44f7f686d5/networking-console-plugin/0.log"
Sep 20 01:28:53.339738 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.339709    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-5wsjj_87ba91cf-c2b1-49c4-b702-33db98397608/download-server/0.log"
Sep 20 01:28:53.340135 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.340048    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"]
Sep 20 01:28:53.340396 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.340381    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d12b7a-33c6-40da-b40a-be4fce7e9e58" containerName="main"
Sep 20 01:28:53.340445 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.340396    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d12b7a-33c6-40da-b40a-be4fce7e9e58" containerName="main"
Sep 20 01:28:53.340445 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.340409    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e812b857-256d-446c-9390-c47e793c2069" containerName="main"
Sep 20 01:28:53.340445 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.340414    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e812b857-256d-446c-9390-c47e793c2069" containerName="main"
Sep 20 01:28:53.340548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.340479    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d12b7a-33c6-40da-b40a-be4fce7e9e58" containerName="main"
Sep 20 01:28:53.340548 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.340487    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e812b857-256d-446c-9390-c47e793c2069" containerName="main"
Sep 20 01:28:53.343402 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.343383    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.345794 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.345771    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjfsx\"/\"openshift-service-ca.crt\""
Sep 20 01:28:53.345943 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.345925    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjfsx\"/\"kube-root-ca.crt\""
Sep 20 01:28:53.346971 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.346945    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjfsx\"/\"default-dockercfg-lzs5j\""
Sep 20 01:28:53.351590 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.351566    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"]
Sep 20 01:28:53.452386 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.452336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqwgm\" (UniqueName: \"kubernetes.io/projected/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-kube-api-access-xqwgm\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.452572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.452417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-podres\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.452572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.452456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-lib-modules\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.452572 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.452559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-sys\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.452692 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.452581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-proc\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553397 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-podres\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-lib-modules\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-sys\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-proc\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553570 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553534    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-podres\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553736 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553567    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-sys\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553736 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqwgm\" (UniqueName: \"kubernetes.io/projected/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-kube-api-access-xqwgm\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553736 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553598    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-lib-modules\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.553736 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.553610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-proc\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.561463 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.561441    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqwgm\" (UniqueName: \"kubernetes.io/projected/dc6e104b-0728-4d0d-b0d4-a31fc88e5f72-kube-api-access-xqwgm\") pod \"perf-node-gather-daemonset-zc4wz\" (UID: \"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.654006 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.653937    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:53.923468 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:53.923441    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"]
Sep 20 01:28:53.926401 ip-10-0-134-159 kubenswrapper[2571]: W0920 01:28:53.926369    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddc6e104b_0728_4d0d_b0d4_a31fc88e5f72.slice/crio-af03b19d1274cc7850d3a879818f54961d961e483e917d215607e75eb7fa9c52 WatchSource:0}: Error finding container af03b19d1274cc7850d3a879818f54961d961e483e917d215607e75eb7fa9c52: Status 404 returned error can't find the container with id af03b19d1274cc7850d3a879818f54961d961e483e917d215607e75eb7fa9c52
Sep 20 01:28:54.606591 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:54.606554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz" event={"ID":"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72","Type":"ContainerStarted","Data":"593d7f6c03241b745c4d93612195efc14d69b26674f8a8ea84f2c0fb9f6c4536"}
Sep 20 01:28:54.607009 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:54.606607    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz" event={"ID":"dc6e104b-0728-4d0d-b0d4-a31fc88e5f72","Type":"ContainerStarted","Data":"af03b19d1274cc7850d3a879818f54961d961e483e917d215607e75eb7fa9c52"}
Sep 20 01:28:54.607009 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:54.606642    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:28:54.621745 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:54.621699    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz" podStartSLOduration=1.621685919 podStartE2EDuration="1.621685919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:28:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:28:54.620342253 +0000 UTC m=+2481.613617786" watchObservedRunningTime="2026-09-20 01:28:54.621685919 +0000 UTC m=+2481.614961451"
Sep 20 01:28:55.347658 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:55.347624    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rpbpb_a749e23e-b6d5-4730-8064-7d0fbb4c5653/dns/0.log"
Sep 20 01:28:55.367427 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:55.367405    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rpbpb_a749e23e-b6d5-4730-8064-7d0fbb4c5653/kube-rbac-proxy/0.log"
Sep 20 01:28:55.389914 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:55.389884    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-529k4_9c2c95f9-a162-46df-96e8-6397b7bcb58c/dns-node-resolver/0.log"
Sep 20 01:28:56.012723 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:56.012693    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64fbdbc8d8-lsztg_51ae6a87-aa24-47cb-ae1d-6ac6ac90b449/registry/0.log"
Sep 20 01:28:56.054593 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:56.054560    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qd5c_86f225a2-931e-4088-b8d2-edbe0ca0406a/node-ca/0.log"
Sep 20 01:28:57.466664 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:57.466637    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-pkc2d_66db052b-2a4d-4f34-8529-9ad9f2becf63/kube-auth-proxy/0.log"
Sep 20 01:28:57.551214 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:57.551160    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-b6lkl_2a6b5bc6-2c3f-4cf3-b25e-1064efece277/istio-proxy/0.log"
Sep 20 01:28:57.553860 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:57.553840    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-b6lkl_2a6b5bc6-2c3f-4cf3-b25e-1064efece277/istio-proxy/1.log"
Sep 20 01:28:58.237628 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:58.237598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:28:58.337014 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:58.336978    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6js95_0b7adc32-efec-40b0-94e9-e8649ba5acff/konnectivity-agent/0.log" limit=1024
Sep 20 01:28:58.501242 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:58.501216    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lzjv_5e9e0af4-0cca-4bb1-9a43-887084c97435/serve-healthcheck-canary/0.log"
Sep 20 01:28:59.024095 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:59.024068    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ffb8_9e785c7e-4e24-40e5-ad0a-f7fee4a90e57/kube-rbac-proxy/0.log"
Sep 20 01:28:59.043395 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:59.043361    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ffb8_9e785c7e-4e24-40e5-ad0a-f7fee4a90e57/exporter/0.log"
Sep 20 01:28:59.063781 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:28:59.063744    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ffb8_9e785c7e-4e24-40e5-ad0a-f7fee4a90e57/extractor/0.log"
Sep 20 01:29:00.620803 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:00.620776    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-zc4wz"
Sep 20 01:29:01.967972 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:01.967936    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-psdlk_2b8b87d4-53ac-47d0-8221-5e639b223b85/manager/0.log"
Sep 20 01:29:01.984801 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:01.984775    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-psdlk_2b8b87d4-53ac-47d0-8221-5e639b223b85/copy-manifests/0.log"
Sep 20 01:29:03.215243 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:03.215212    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-694bb85cb6-7hj8t_5bc9cde9-5644-47e0-a35f-a296967a8fe7/manager/0.log"
Sep 20 01:29:03.265112 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:03.265087    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jxp74_d03a6390-7789-4397-b5c2-cfd99483cef3/openshift-lws-operator/0.log"
Sep 20 01:29:04.187472 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:04.187439    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-pkc2d_66db052b-2a4d-4f34-8529-9ad9f2becf63/kube-auth-proxy/0.log"
Sep 20 01:29:04.222474 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:04.222447    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-b6lkl_2a6b5bc6-2c3f-4cf3-b25e-1064efece277/istio-proxy/0.log"
Sep 20 01:29:04.225634 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:04.225612    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-b6lkl_2a6b5bc6-2c3f-4cf3-b25e-1064efece277/istio-proxy/1.log"
Sep 20 01:29:06.360766 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:06.360741    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9c7c6d7b-pkc2d_66db052b-2a4d-4f34-8529-9ad9f2becf63/kube-auth-proxy/0.log"
Sep 20 01:29:06.401591 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:06.401558    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-b6lkl_2a6b5bc6-2c3f-4cf3-b25e-1064efece277/istio-proxy/0.log"
Sep 20 01:29:06.405114 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:06.405074    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-b6lkl_2a6b5bc6-2c3f-4cf3-b25e-1064efece277/istio-proxy/1.log"
Sep 20 01:29:08.696170 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:08.696135    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-6rdvd_cf4845f5-4024-4c1b-93e7-97e6417cbf8f/migrator/0.log"
Sep 20 01:29:08.715129 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:08.715101    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-6rdvd_cf4845f5-4024-4c1b-93e7-97e6417cbf8f/graceful-termination/0.log"
Sep 20 01:29:10.217625 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.217594    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h59fj_2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8/kube-multus-additional-cni-plugins/0.log"
Sep 20 01:29:10.237346 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.237319    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h59fj_2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8/egress-router-binary-copy/0.log"
Sep 20 01:29:10.257379 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.257359    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h59fj_2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8/cni-plugins/0.log"
Sep 20 01:29:10.276301 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.276279    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h59fj_2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8/bond-cni-plugin/0.log"
Sep 20 01:29:10.296102 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.296083    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h59fj_2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8/routeoverride-cni/0.log"
Sep 20 01:29:10.315844 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.315823    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h59fj_2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8/whereabouts-cni-bincopy/0.log"
Sep 20 01:29:10.335131 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.335113    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h59fj_2eda13ee-44ab-4bf4-8b6e-4cc4cdd32fc8/whereabouts-cni/0.log"
Sep 20 01:29:10.553850 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.553823    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k4w8t_b8e070d0-7f29-4f45-a2aa-c3f6e62823a9/kube-multus/0.log"
Sep 20 01:29:10.614698 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.614670    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9brst_8a92ad3c-5004-4ec6-a9b0-30d474ee931e/network-metrics-daemon/0.log"
Sep 20 01:29:10.631658 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:10.631630    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9brst_8a92ad3c-5004-4ec6-a9b0-30d474ee931e/kube-rbac-proxy/0.log"
Sep 20 01:29:11.671763 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.671733    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/ovn-controller/0.log"
Sep 20 01:29:11.687330 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.687304    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/ovn-acl-logging/0.log"
Sep 20 01:29:11.708649 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.708620    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/kube-rbac-proxy-node/0.log"
Sep 20 01:29:11.728277 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.728257    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/kube-rbac-proxy-ovn-metrics/0.log"
Sep 20 01:29:11.748547 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.748530    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/northd/0.log"
Sep 20 01:29:11.767670 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.767654    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/nbdb/0.log"
Sep 20 01:29:11.790033 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.790014    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/sbdb/0.log"
Sep 20 01:29:11.845730 ip-10-0-134-159 kubenswrapper[2571]: I0920 01:29:11.845705    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pzbh7_77831236-c544-497a-89ad-d352f3a8b1ab/ovnkube-controller/0.log"